Crawl Update (Idle Words)#

05.22.2003

After a dispiriting two days of zapping duplicate URLs, and watching the crawl count drop by tens of thousands of weblogs, it looks like we hit a rich pocket of ore in the site queue. Minutes ago, the census crawl nosed past Technorati, with about a third of a million weblog sites indexed. I believe this is now the largest general weblog list on the Web. I have put an extra sugar in my coffee to celebrate.

Crawls are meant for sharing, so I will have the data up along with various derivative charts as soon as I get some domain registrar monkey business cleared up. In the meantime, you can always see the latest numbers on the crawl page.