| 95 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 91505+44 | 4.01 GB | 31 May 2009 - 23:59 |
| Yahoo Slurp | 119792+161 | 4.69 GB | 31 May 2009 - 23:59 |
| MSNBot | 74481+1318 | 2.06 GB | 31 May 2009 - 23:59 |
| Exabot | 10764+20 | 61.52 MB | 31 May 2009 - 23:59 |
| MSNBot-media | 11451+2611 | 1.61 GB | 31 May 2009 - 23:58 |
| Voila | 2406+28 | 31.60 MB | 31 May 2009 - 23:57 |
| Unknown robot (identified by hit on 'robots.txt') | 0+3236 | 1.16 MB | 31 May 2009 - 23:56 |
| Ask | 3618+102 | 168.88 MB | 31 May 2009 - 23:51 |
| Unknown robot (identified by 'crawl') | 5089+1673 | 87.48 MB | 31 May 2009 - 23:49 |
| FAST Enterprise Crawler | 5831+13 | 411.59 MB | 31 May 2009 - 23:49 |
| Nagios | 12702 | 30.53 MB | 31 May 2009 - 23:48 |
| Yahoo! Slurp China | 457+41 | 14.87 MB | 31 May 2009 - 23:39 |
| Unknown robot (identified by 'spider') | 6538+892 | 79.05 MB | 31 May 2009 - 23:37 |
| larbin | 608+261 | 7.70 MB | 31 May 2009 - 23:35 |
| Unknown robot (identified by 'robot') | 16465+141 | 247.88 MB | 31 May 2009 - 23:33 |
| Powermarks | 408 | 580.96 KB | 31 May 2009 - 23:29 |
| BaiDuSpider | 796+36 | 10.96 MB | 31 May 2009 - 23:10 |
| Feedfetcher-Google | 166 | 955.99 KB | 31 May 2009 - 22:58 |
| MJ12bot | 49+11 | 832.29 KB | 31 May 2009 - 22:52 |
| BlogSearch | 22 | 783.43 KB | 31 May 2009 - 22:50 |
| CFNetwork | 163 | 32.87 MB | 31 May 2009 - 22:38 |
| Google AdSense | 29 | 925.98 KB | 31 May 2009 - 22:36 |
| UniversalFeedParser | 122 | 161.56 KB | 31 May 2009 - 22:14 |
| Java (Often spam bot) | 1753+3 | 29.42 MB | 31 May 2009 - 22:07 |
| Speedy Spider | 325+67 | 9.61 MB | 31 May 2009 - 21:50 |
| Nutch | 1303+125 | 51.50 MB | 31 May 2009 - 21:45 |
| Python-urllib | 270+117 | 87.21 MB | 31 May 2009 - 21:27 |
| BSpider | 42+7 | 1.77 MB | 31 May 2009 - 21:22 |
| WebCollage | 160 | 11.45 MB | 31 May 2009 - 20:50 |
| Yandex bot | 4382+68 | 3.48 MB | 31 May 2009 - 20:41 |
| UP.Browser | 266 | 20.87 MB | 31 May 2009 - 20:20 |
| The web archive (IA Archiver) | 0+360 | 135.70 KB | 31 May 2009 - 20:14 |
| Unknown robot (identified by 'bot/' or 'bot-') | 3252+111 | 54.44 MB | 31 May 2009 - 19:50 |
| Alexa (IA Archiver) | 719+56 | 23.72 MB | 31 May 2009 - 19:42 |
| lwp-request | 20 | 54.62 KB | 31 May 2009 - 19:06 |
| Custo | 283+40 | 19.82 MB | 31 May 2009 - 18:36 |
| MLBot | 2190+25 | 10.27 MB | 31 May 2009 - 18:27 |
| yacy | 259+56 | 8.85 MB | 31 May 2009 - 18:25 |
| NewsGator Online | 54 | 0 | 31 May 2009 - 15:46 |
| HTMLParser | 11 | 1.68 MB | 31 May 2009 - 14:54 |
| VSE | 90 | 4.11 MB | 31 May 2009 - 14:45 |
| Jakarta commons-httpclient | 202+20 | 9.45 MB | 31 May 2009 - 13:16 |
| DoCoMo | 51+4 | 459.27 KB | 31 May 2009 - 13:09 |
| TencentTraveler | 193 | 27.77 MB | 31 May 2009 - 11:02 |
| WordPress | 68 | 150.97 KB | 31 May 2009 - 10:55 |
| Motor | 57 | 1.54 MB | 31 May 2009 - 10:19 |
| Fish search | 15 | 3.18 MB | 31 May 2009 - 07:49 |
| MSIECrawler | 51+31 | 346.41 KB | 31 May 2009 - 06:14 |
| LinkWalker | 30+15 | 152.27 KB | 31 May 2009 - 02:33 |
| GigaBot | 1432+248 | 16.21 MB | 30 May 2009 - 23:53 |
| Turn It In | 227+2 | 2.62 MB | 30 May 2009 - 21:36 |
| Xenu Link Sleuth | 25 | 162.28 KB | 30 May 2009 - 17:18 |
| Web Core / Roots | 5 | 8.19 MB | 30 May 2009 - 15:35 |
| Heritrix | 8+8 | 245.10 KB | 30 May 2009 - 15:10 |
| lwp-trivial | 1 | 129.07 KB | 29 May 2009 - 17:09 |
| Holmes | 1+1 | 720.52 KB | 29 May 2009 - 11:52 |
| Susie | 1 | 188.65 KB | 29 May 2009 - 02:51 |
| W3C Validator | 2 | 9.80 KB | 28 May 2009 - 01:44 |
| Microsoft URL Control | 15 | 424.78 KB | 27 May 2009 - 20:28 |
| Boris | 3 | 72.32 KB | 27 May 2009 - 13:57 |
| BBot | 10 | 1.06 MB | 27 May 2009 - 12:35 |
| HTTrack off-line browser | 9+1 | 5.04 MB | 27 May 2009 - 08:02 |
| Grub.org | 84 | 436.06 KB | 27 May 2009 - 01:35 |
| Sunrise | 2 | 18.72 KB | 26 May 2009 - 14:06 |
| Netcraft | 6 | 25.60 KB | 26 May 2009 - 13:37 |
| legs | 0+3 | 1.13 KB | 26 May 2009 - 12:32 |
| Ocelli | 162+1 | 1.49 MB | 26 May 2009 - 01:41 |
| WallPaper (alias crawlpaper) | 3 | 159.58 KB | 24 May 2009 - 21:10 |
| Scooter | 0+6 | 2.26 KB | 24 May 2009 - 05:46 |
| Vagabondo | 0+3 | 1.13 KB | 23 May 2009 - 22:02 |
| Internet Shinchakubin | 9 | 206.17 KB | 23 May 2009 - 12:21 |
| NG 2.x (Exalead) | 5+4 | 341.45 KB | 23 May 2009 - 12:14 |
| DWCP (Dridus' Web Cataloging Project) | 1 | 7.15 KB | 23 May 2009 - 08:44 |
| psbot | 1505+64 | 3.62 MB | 23 May 2009 - 07:11 |
| Checkbot | 12 | 3.54 KB | 23 May 2009 - 03:21 |
| YahooSeeker Yahoo! Blog crawler | 0+2 | 772 Bytes | 22 May 2009 - 23:29 |
| VORTEX | 1 | 12.75 KB | 22 May 2009 - 22:44 |
| Cursor | 24 | 775.79 KB | 21 May 2009 - 22:58 |
| Gaisbot | 784+6 | 7.18 MB | 21 May 2009 - 18:41 |
| Miva | 1 | 18.77 KB | 21 May 2009 - 04:13 |
| GPU p2p crawler | 4+2 | 70.09 KB | 20 May 2009 - 21:45 |
| Feedburner | 3 | 1020 Bytes | 20 May 2009 - 20:42 |
| TestBot | 1 | 6.04 KB | 20 May 2009 - 20:35 |
| The World Wide Web Worm | 5 | 1.66 MB | 20 May 2009 - 13:55 |
| FavOrg | 1 | 9.29 KB | 20 May 2009 - 10:16 |
| InfoBot | 47+2 | 1.34 MB | 20 May 2009 - 09:53 |
| Voyager | 75+11 | 2.82 MB | 19 May 2009 - 19:00 |
| NutchCVS | 24+1 | 89.56 KB | 19 May 2009 - 00:19 |
| archive.org bot | 4+1 | 254.53 KB | 18 May 2009 - 14:49 |
| WebVac | 4412 | 18.96 MB | 08 May 2009 - 00:21 |
| Web Downloader | 2 | 6.99 KB | 06 May 2009 - 04:33 |
| StackRambler | 9 | 70.78 KB | 05 May 2009 - 19:46 |
| Ultraseek | 20+1 | 1.28 MB | 04 May 2009 - 05:04 |
| Yahoo-MMCrawler | 1+1 | 26.00 KB | 02 May 2009 - 09:38 |
| ASPseek | 1 | 5.38 KB | 01 May 2009 - 12:24 |