Axandra news archive: 4 March 2008

This week, we're taking a look at Google's new method to detect duplicate content.

In the news: paid search statistics, Yahoo updates its ranking algorithm, Google gets less paid clicks, how click fraud works in India and more.

Table of contents:

• Facts of the week
• Search engine news of the week
• Articles of the week
• Miscellaneous
• Win a $100 Amazon coupon
• Previous articles

Google doesn't like duplicate content. The reason for that is that the top 10 search results should offer users a choice of different web pages.

Google's new patent application on near duplicate content describes a new method how Google tries to keep its users from finding redundant content in the result pages.

Content may be duplicated for a variety of reasons

There are many reasons why content is duplicated on more than one page, or why documents are very similar:

1. The content of a web page is available in different formats: web page, printable page, PDF, mobile phone page, etc.
2. The content of a web page is syndicated, for example news articles or blog posts.
3. The content management system (CMS) displays the same content in different locations. For example, an item might be listed in a "Size" category and in a "Color" category.
4. The website owner offers mirrors to make sure that a website does not slow down when many people want to access the same page at the same time.
5. Someone stole the contents of a web page to reproduce it on other websites.

To avoid showing the same content more than once in the search results, search engines try to detect these duplicate pages.

What's in the patent application?

The patent application describes how Google tries to detect duplicate or near duplicate content at different web addresses. It seems that Google might combine several existing methods for detecting new duplicate content to identify more duplicates on the Internet.

The new patent application shows that Google is serious about detecting duplicate content issues. This new patent application is only the latest step in Google's attempts to detect duplicate content. For example, previous steps can be found here (PDF) and here.

What does Google do when it detects duplicate content?

It's hard to tell what Google will do when they find duplicate pages. There are many instances where duplicated content is used for a legitimate purpose.

If Google only removes the duplicate pages from the search results for a certain query that might be okay. If Google penalized duplicate pages by removing them completely from the index, Google might risk not being relevant for very specific queries and it also might penalize the wrong pages.

It's likely that Google will pick the web page with the best reputation and the best inbound links for the search results if it finds more than one page with the same content.

What does this mean for your website?

If you want to get high rankings, it is easier to do so with unique content. Try to use as much original content as possible on your web pages.

If your website must use the same content as another website, make sure that your website has better inbound links than the other websites that carry the same content.

Back to table of contents - Visit Axandra.com

"From January 2008 to February 2008, Google picked up 2.3 points of ad spend share. Google’s growth came at the expense of Yahoo (down 1.6 points), Microsoft (down 0.6 points), and Ask (down 0.1 points). [...]

Comparing February 2008 to February 2007, we did not observe evidence of an advertising or sales slow-down: median same-client Google ad-spend was up 22% year-over-year, and corresponding same-client resulting PPC sales were up 26%."

"Online search site Ask.com is not getting rid of its specialized search technology, a source familiar with the matter said on Friday, saying a blog report to that effect was incorrect."

Yahoo updates its ranking algorithm

"We're in the process of rolling out some changes to our crawling, indexing and ranking algorithms. While we expect the update will be completed soon, as you know, throughout this process you may see some ranking changes and page shuffling in the index."

Search engine newslets

• Spammers invade Google Calendar.
• My stunted interview with Google's Eric Schmidt.
• Microsoft: Google is our only competitor in ad-platform game.
• Google formally announces Google Health.
• How Google is handling the UK earthquake.

"IBP brought my website to number 1 on Google "

"IBP brought my website hypermiling.com to number 1 on Google last December 2007, then after that my website became an authority hub on Google, for the search term hypermiling.

As a result of IBP my site has been noticed by many TV news stations around the USA as well as times of london & the websites of slate & wired."
Steve Chafe, Hypermiling.com

"IBP pushed our agency website within a few weeks on very high positions in google and yahoo. That's amazing.

IBP is very easy to handle and helped us to save a lot of money for hiring an external SEO expert.

We are very happy with IBP and can recommend it to everyone. We can already feel our increased sales due to our better positions. Great product!!!"
Harald Eberl, Stockfood.com

We're looking for feedback to IBP version 10. Tell us how IBP has helped to improve your online business.

The names of all participants will be entered into a raffle for a $100 Amazon coupon. Thank you for helping us make IBP the best SEO tool!

• How Yahoo's phrased based indexing affects your website rankings
• Get top 10 rankings on Google & Yahoo with the all-new IBP 10
• Seven things you can do to improve the link structure of your website
• Google backs out of the position 6 penalty
• New technologies detect black-hat SEO methods
• Mosaic cloaking: a new form of search engine spam?
• Google's new position 6 penalty
• View all past issues...