free html hit counter Indexing Speed | John Battelle's Search Blog
Related Posts Plugin for WordPress, Blogger...
  • Matt Cox

    Ace! Although I can’t find this individual post (as in yours, John), the front page description for battlemedia.com has updated with the latest post.

    …whereas my lowly blog still hasn’t had yesterday’s post indexed. :(

  • Manish

    in my personal sample size of 1, i see that yahoo! has the faster indexing speed. the personal sample is the foll. : search for ‘citipals’ on both y! and g!. the first result is for the website http://www.citipals.com . y! cached copy is less than 24 hrs old, whereas g! cached copy is approx. 7 days old.

    i’m assuming that a page showing up in cache is equivalent to it being updated in the index, which might not be true.

    however, on the topic of comprehensiveness, based on my sample ( size 1 ), i can see that g! has an edge over y!.

  • http://datamining.typepad.com/data_mining Matthew Hurst

    Nearly all blog search engines (Technorati, Blogpulse, Google’s blogsearch) have been at this type of refresh speed for a long time. I doubt that Matt is seeing any real difference in Google’s crawl/index rates and simply the integration of the ‘live’ blog crawl with the main index. Technorati has claimed a mean time to index (MTI) of 5 minutes (though this is a rather tricky statistic).

  • Walter Underwood

    This is usually called “index freshness”, not “indexing speed”. Two spiders might have the same speed, but if one is visiting pages that changed and one is visiting pages that didn’t change, the first will have better freshness.

    Infoseek had very fast updates ten years ago. It is nice to see that coming back to web search.