Subscribe to Vincent Granville's Weekly Digest:
For each search query, search engines identify the most relevant web pages (links) and then rank them, before displaying the search result page for a particular keyword.

This keyword and page matching/ranking technology is subject to a sophisticated type of keyword relevancy fraud. It impacts organic search as well as paid search. Here's how it works:

  • An advertiser selling data mining software buys a domain name such as bluedatamining.com
  • With a botnet, the advertiser creates a large volume of impressions on Google search for keywords such as "data mining bluedatamining", "web analytics bluedatamining", "data analysis bluedatamining"
  • The advertiser creates clicks too, with a slightly higher CTR for bluedatamining.com than for competitors; bluedatamining.com should show up in the top on the search result page for keywords that include the term bluedatamining
  • After a while, Google algorithm will believe that bluedatamining is a term that is very relevant/associated to "data mining", "web analytics", "data analysis"
  • Eventually, the domain bluedatamining.com will show up first for top keywords such as "data mining", "web analytics", etc.

The trick here consists of creating artificial relationships between a low and large volume keywords, in order to eventually appear in the top results for popular keywords.

Question: how can this type of fraud be detected?

Views: 22

Replies to This Discussion

Anyone interested in testing this theory? You'd need to use a domain name with real, relevant content, with 50+ pages of content, e.g. one product description per page. It would not work with bluedatamining.com because it has no content -- the domain name is actually available. It's a good domain for this type of test though, because it contains "datamining", which should boost keyword relevancy.
Amazing - I searched for "bluedatamining" and the first 2 results are from this discussion. I guess it's been over a year since the post - so their database had time to find this discussion. (I know it's slightly off topic, but amazing just the same)
I don't think you need to simulate some realistic CTR. Organic links on Google are straight links (no redirect), so Google has no way to know whether you click on a link or not (this applies to organic results only, not to paid results).
BTW Google has started using redirects
There are many other flaws currently in the Google algorithm that leave it open for misuse. The one you mentioned has a simple solution. For one, they have developed a fraud detection system for "Paid" clicks that is already in place. Google can definitely track the external links being clicked on. It's just a matter of developing the right infrastructure in the process.

You will notice many websites that arise on the top results of Google that are not very high quality, but are "optimized" for the search engines. I've done some very intense level studies of the top ranking websites, what makes them on top, have done testing to gauge the results in the search engines, and have a very good understanding of how they rank many of the different factors.

They still definitely have the best quality search engine out there for the moment, even with these flaws, but instead of hiring mostly engineers, and people with specific school/work credentials, they would benefit greatly from hiring inventive people who are good at thinking of creative solutions to problems, understanding the customer, and have a background as a marketing professional. A person like this can drive the innovative process with an integrated understanding of how to improve search from beyond either an academic or engineering perspective.

It seems to be a growing trend that many large companies lose out on creative talent today by focusing too much on things like degrees in certain area, or certain types of work experience. And I'm sure it's harder as a large company to do it differently, but talent is talent wherever it comes from. J.K. Rowling had nothing on her resume before writing Harry Potter. Many creative people are like that. I had no idea what paid ads were before my first job in that area, and within 3 months the company that "took a risk on me with that" made a LOT of money from my work (nearly 300% increase in ROI), whereas their sales had been stagnating for years before.

They definitely have very talented people there, and have very high level innovation there, but they are still missing a vitally important segment and vantage point, which leaves them in a potentially weak position.

I, for one, would love to help them or any other search engine resolve these issues. I've done a lot of studying and creative thinking about how to resolve these processes, and I would love to share my ideas as part of a creative process to help improve it.

RSS

Follow us

© 2013   AnalyticBridge.com is a subsidiary and dedicated channel of Data Science Central LLC

Badges  |  Report an Issue  |  Terms of Service