Matt points out that Google’s indexing speed has increased and uses blog entries as an example. I’ve certainly noticed how fast Google indexes this blog, it’s markedly faster than a year ago.
Indexing Speed
Matt points out that Google's indexing speed has increased and uses blog entries as an example. I've certainly noticed how fast Google indexes this blog, it's markedly faster than a year ago….
Ace! Although I can’t find this individual post (as in yours, John), the front page description for battlemedia.com has updated with the latest post.
…whereas my lowly blog still hasn’t had yesterday’s post indexed. 🙁
in my personal sample size of 1, i see that yahoo! has the faster indexing speed. the personal sample is the foll. : search for ‘citipals’ on both y! and g!. the first result is for the website http://www.citipals.com . y! cached copy is less than 24 hrs old, whereas g! cached copy is approx. 7 days old.
i’m assuming that a page showing up in cache is equivalent to it being updated in the index, which might not be true.
however, on the topic of comprehensiveness, based on my sample ( size 1 ), i can see that g! has an edge over y!.
Nearly all blog search engines (Technorati, Blogpulse, Google’s blogsearch) have been at this type of refresh speed for a long time. I doubt that Matt is seeing any real difference in Google’s crawl/index rates and simply the integration of the ‘live’ blog crawl with the main index. Technorati has claimed a mean time to index (MTI) of 5 minutes (though this is a rather tricky statistic).
This is usually called “index freshness”, not “indexing speed”. Two spiders might have the same speed, but if one is visiting pages that changed and one is visiting pages that didn’t change, the first will have better freshness.
Infoseek had very fast updates ten years ago. It is nice to see that coming back to web search.