Thursday, June 23, 2005

Google Indexes Less

John Battelle again writes about Tristan's discovery that Google does a vastly poorer job indexing blogs than Yahoo and Technorati.

This is no news but rather a general fact. Google almost always indexes fewer referring pages for any given URL vis a vis Yahoo or MSN. In fact, it seems that MSN does the best job of indexing, closely followed by Yahoo. I was astounded to discover that this is the case, but it really does hold true. Tristan just uncovered the blogging part of a greater truth--Google does an inferior job indexing pages as compared to Yahoo and MSN.

Why does Google do it this way? Google is not dumb. They realize that 80% of people only look at the first page of results, thus they weight it to the top to reduce the computational and storage loads for their server clusters. The real question is why Google publicly claims otherwise. Either Yahoo and MSN are understating their reach or Google is overstating its. I am not sure where the truth lies, but I'd be interested to find out.

Bookmark and check back next week for an analysis of this topic. I'll work on it this weekend.


Post a Comment

<< Home