| 100 different robots | Hits | Bandwidth | Last visit |
|---|
| Load Balancing Server | 1449912 | 15.68 GB | 31 May 2009 - 23:59 |
| MLBot | 252479+25 | 2.46 GB | 31 May 2009 - 23:59 |
| Googlebot | 95877+44 | 4.41 GB | 31 May 2009 - 23:59 |
| Yahoo Slurp | 137199+161 | 13.21 GB | 31 May 2009 - 23:59 |
| MSNBot | 372709+1318 | 25.30 GB | 31 May 2009 - 23:59 |
| Exabot | 10920+20 | 62.44 MB | 31 May 2009 - 23:59 |
| FAST Enterprise Crawler | 28309+13 | 1.17 GB | 31 May 2009 - 23:59 |
| MSNBot-media | 14813+2611 | 2.38 GB | 31 May 2009 - 23:58 |
| Voila | 2498+28 | 34.78 MB | 31 May 2009 - 23:57 |
| Unknown robot (identified by hit on 'robots.txt') | 0+3236 | 1.16 MB | 31 May 2009 - 23:56 |
| Ask | 3786+102 | 210.10 MB | 31 May 2009 - 23:51 |
| Unknown robot (identified by 'crawl') | 5595+1673 | 112.76 MB | 31 May 2009 - 23:49 |
| Nagios | 18156 | 91.32 MB | 31 May 2009 - 23:48 |
| LiveJournal.com | 476 | 18.63 MB | 31 May 2009 - 23:42 |
| Yahoo! Slurp China | 484+41 | 15.50 MB | 31 May 2009 - 23:39 |
| Unknown robot (identified by 'spider') | 6923+892 | 86.53 MB | 31 May 2009 - 23:37 |
| Jakarta commons-httpclient | 296+20 | 33.89 MB | 31 May 2009 - 23:36 |
| larbin | 876+261 | 9.35 MB | 31 May 2009 - 23:35 |
| Unknown robot (identified by 'robot') | 56143+141 | 697.50 MB | 31 May 2009 - 23:33 |
| Powermarks | 410 | 1.23 MB | 31 May 2009 - 23:29 |
| BaiDuSpider | 2117+36 | 27.23 MB | 31 May 2009 - 23:20 |
| Java (Often spam bot) | 14039+3 | 1004.47 MB | 31 May 2009 - 23:14 |
| Feedfetcher-Google | 166 | 955.99 KB | 31 May 2009 - 22:58 |
| yacy | 315+56 | 9.92 MB | 31 May 2009 - 22:53 |
| MJ12bot | 2039+11 | 82.99 MB | 31 May 2009 - 22:52 |
| BlogSearch | 22 | 783.43 KB | 31 May 2009 - 22:50 |
| CFNetwork | 246 | 382.50 MB | 31 May 2009 - 22:38 |
| Google AdSense | 29 | 925.98 KB | 31 May 2009 - 22:36 |
| UniversalFeedParser | 122 | 161.56 KB | 31 May 2009 - 22:14 |
| Nutch | 1337+125 | 51.76 MB | 31 May 2009 - 22:03 |
| Speedy Spider | 498+67 | 12.51 MB | 31 May 2009 - 21:50 |
| Python-urllib | 317+117 | 159.06 MB | 31 May 2009 - 21:27 |
| BSpider | 42+7 | 1.77 MB | 31 May 2009 - 21:22 |
| WebCollage | 160 | 11.45 MB | 31 May 2009 - 20:50 |
| Yandex bot | 4402+68 | 3.67 MB | 31 May 2009 - 20:41 |
| UP.Browser | 275 | 29.18 MB | 31 May 2009 - 20:20 |
| The web archive (IA Archiver) | 0+360 | 135.70 KB | 31 May 2009 - 20:14 |
| Unknown robot (identified by 'bot/' or 'bot-') | 3419+111 | 60.13 MB | 31 May 2009 - 19:50 |
| Alexa (IA Archiver) | 757+56 | 32.40 MB | 31 May 2009 - 19:42 |
| lwp-request | 20 | 54.62 KB | 31 May 2009 - 19:06 |
| Custo | 307+40 | 42.74 MB | 31 May 2009 - 18:36 |
| NewsGator Online | 54 | 0 | 31 May 2009 - 15:46 |
| HTMLParser | 11 | 1.68 MB | 31 May 2009 - 14:54 |
| VSE | 93 | 10.51 MB | 31 May 2009 - 14:45 |
| TencentTraveler | 215 | 35.80 MB | 31 May 2009 - 13:51 |
| DoCoMo | 110+4 | 1.15 MB | 31 May 2009 - 13:09 |
| WordPress | 73 | 2.98 MB | 31 May 2009 - 10:55 |
| BBot | 14 | 2.10 MB | 31 May 2009 - 10:51 |
| Motor | 57 | 1.54 MB | 31 May 2009 - 10:19 |
| Fish search | 16 | 3.87 MB | 31 May 2009 - 07:49 |
| MSIECrawler | 53+31 | 358.37 KB | 31 May 2009 - 06:14 |
| LinkWalker | 33+15 | 152.27 KB | 31 May 2009 - 02:33 |
| GigaBot | 1472+248 | 16.35 MB | 30 May 2009 - 23:53 |
| Turn It In | 663+2 | 8.40 MB | 30 May 2009 - 21:36 |
| Xenu Link Sleuth | 25 | 162.28 KB | 30 May 2009 - 17:18 |
| Web Core / Roots | 9 | 10.63 MB | 30 May 2009 - 15:35 |
| Heritrix | 10+8 | 7.95 MB | 30 May 2009 - 15:10 |
| Ocelli | 181+1 | 1.55 MB | 30 May 2009 - 05:06 |
| lwp-trivial | 3 | 1.50 MB | 29 May 2009 - 17:09 |
| Holmes | 2+1 | 1.29 MB | 29 May 2009 - 11:52 |
| Susie | 1 | 188.65 KB | 29 May 2009 - 02:51 |
| HTTrack off-line browser | 51+1 | 9.75 MB | 28 May 2009 - 08:44 |
| W3C Validator | 2 | 9.80 KB | 28 May 2009 - 01:44 |
| Microsoft URL Control | 15 | 424.78 KB | 27 May 2009 - 20:28 |
| Boris | 3 | 72.32 KB | 27 May 2009 - 13:57 |
| Grub.org | 89 | 443.84 KB | 27 May 2009 - 01:35 |
| Sunrise | 2 | 18.72 KB | 26 May 2009 - 14:06 |
| Netcraft | 23 | 112.58 KB | 26 May 2009 - 13:37 |
| legs | 0+3 | 1.13 KB | 26 May 2009 - 12:32 |
| SpiderView(tm) | 2 | 20.98 KB | 26 May 2009 - 00:03 |
| TITAN | 2 | 4.86 MB | 25 May 2009 - 21:27 |
| Cursor | 25 | 6.48 MB | 25 May 2009 - 20:55 |
| WallPaper (alias crawlpaper) | 3 | 159.58 KB | 24 May 2009 - 21:10 |
| MojeekBot | 33 | 232.23 KB | 24 May 2009 - 10:34 |
| VORTEX | 4 | 44.17 KB | 24 May 2009 - 09:34 |
| Scooter | 0+6 | 2.26 KB | 24 May 2009 - 05:46 |
| Vagabondo | 0+3 | 1.13 KB | 23 May 2009 - 22:02 |
| Internet Shinchakubin | 9 | 206.17 KB | 23 May 2009 - 12:21 |
| NG 2.x (Exalead) | 6+4 | 382.36 KB | 23 May 2009 - 12:14 |
| DWCP (Dridus' Web Cataloging Project) | 1 | 7.15 KB | 23 May 2009 - 08:44 |
| psbot | 1514+64 | 3.70 MB | 23 May 2009 - 07:11 |
| Gaisbot | 788+6 | 7.22 MB | 23 May 2009 - 04:58 |
| Checkbot | 12 | 3.54 KB | 23 May 2009 - 03:21 |
| YahooSeeker Yahoo! Blog crawler | 0+2 | 772 Bytes | 22 May 2009 - 23:29 |
| Miva | 1 | 18.77 KB | 21 May 2009 - 04:13 |
| GPU p2p crawler | 4+2 | 70.09 KB | 20 May 2009 - 21:45 |
| Feedburner | 3 | 1020 Bytes | 20 May 2009 - 20:42 |
| TestBot | 1 | 6.04 KB | 20 May 2009 - 20:35 |
| The World Wide Web Worm | 5 | 1.66 MB | 20 May 2009 - 13:55 |
| FavOrg | 1 | 9.29 KB | 20 May 2009 - 10:16 |
| InfoBot | 47+2 | 1.34 MB | 20 May 2009 - 09:53 |
| Voyager | 82+11 | 2.95 MB | 19 May 2009 - 19:00 |
| NutchCVS | 24+1 | 89.56 KB | 19 May 2009 - 00:19 |
| archive.org bot | 4+1 | 254.53 KB | 18 May 2009 - 14:49 |
| Web Downloader | 3 | 17.47 KB | 18 May 2009 - 10:53 |
| WebVac | 4412 | 18.96 MB | 08 May 2009 - 00:21 |
| StackRambler | 9 | 70.78 KB | 05 May 2009 - 19:46 |
| Ultraseek | 20+1 | 1.28 MB | 04 May 2009 - 05:04 |
| Yahoo-MMCrawler | 1+1 | 26.00 KB | 02 May 2009 - 09:38 |
| ASPseek | 1 | 5.38 KB | 01 May 2009 - 12:24 |