| 64 different robots | Hits | Bandwidth | Last visit |
|---|
| Load Balancing Server | 480814 | 1.71 GB | 31 Jul 2010 - 23:49 |
| Yandex bot | 2202+128 | 30.74 MB | 31 Jul 2010 - 23:49 |
| Googlebot | 89745+312 | 806.62 MB | 31 Jul 2010 - 23:49 |
| Yahoo Slurp | 6917+313 | 968.97 MB | 31 Jul 2010 - 23:47 |
| Unknown robot (identified by 'crawl') | 7388+2838 | 34.88 MB | 31 Jul 2010 - 23:44 |
| Nagios | 7936 | 96.76 MB | 31 Jul 2010 - 23:36 |
| MSNBot | 940+1458 | 32.27 MB | 31 Jul 2010 - 23:22 |
| Yahoo! Slurp China | 20+59 | 112.33 KB | 31 Jul 2010 - 23:22 |
| MLBot | 25+75 | 214.44 KB | 31 Jul 2010 - 23:14 |
| Python-urllib | 8130 | 2.05 GB | 31 Jul 2010 - 23:12 |
| BaiDuSpider | 1213+252 | 222.67 MB | 31 Jul 2010 - 22:43 |
| Java (Often spam bot) | 3390+2 | 122.86 MB | 31 Jul 2010 - 22:22 |
| MSNBot-media | 395+284 | 24.48 MB | 31 Jul 2010 - 22:11 |
| Unknown robot (identified by 'spider') | 210+116 | 2.93 MB | 31 Jul 2010 - 21:34 |
| Unknown robot (identified by 'robot') | 54582+1723 | 129.61 MB | 31 Jul 2010 - 20:36 |
| Unknown robot (identified by hit on 'robots.txt') | 0+377 | 151.25 KB | 31 Jul 2010 - 20:11 |
| Unknown robot (identified by 'bot/' or 'bot-') | 1424+311 | 45.26 MB | 31 Jul 2010 - 20:10 |
| Alexa (IA Archiver) | 8+21 | 839.10 KB | 31 Jul 2010 - 18:27 |
| HTTrack off-line browser | 5+17 | 128.61 KB | 31 Jul 2010 - 17:58 |
| Exabot | 50+26 | 538.85 KB | 31 Jul 2010 - 16:19 |
| CFNetwork | 78 | 1.03 GB | 31 Jul 2010 - 15:34 |
| DoCoMo | 11+25 | 72.73 KB | 31 Jul 2010 - 13:55 |
| Nutch | 31+25 | 268.37 KB | 31 Jul 2010 - 12:55 |
| The web archive (IA Archiver) | 0+11 | 3.56 KB | 31 Jul 2010 - 12:04 |
| Voila | 89+42 | 3.58 MB | 31 Jul 2010 - 11:54 |
| Findlinks | 10+2 | 52.38 KB | 31 Jul 2010 - 09:40 |
| MJ12bot | 39+30 | 476.57 KB | 31 Jul 2010 - 05:26 |
| Web Core / Roots | 146 | 139.66 MB | 31 Jul 2010 - 02:24 |
| YahooSeeker Yahoo! Blog crawler | 0+7 | 2.26 KB | 31 Jul 2010 - 01:13 |
| BSpider | 84+32 | 767.78 KB | 30 Jul 2010 - 20:36 |
| Custo | 18+17 | 3.02 MB | 30 Jul 2010 - 19:02 |
| MSIECrawler | 2+7 | 4.26 KB | 30 Jul 2010 - 04:56 |
| legs | 7+11 | 119.03 KB | 29 Jul 2010 - 17:26 |
| UP.Browser | 20 | 548.25 KB | 29 Jul 2010 - 17:12 |
| Ask | 40+44 | 2.15 MB | 29 Jul 2010 - 10:41 |
| SpiderMan | 1+1 | 184.42 KB | 29 Jul 2010 - 07:48 |
| arks | 8 | 25.35 MB | 29 Jul 2010 - 02:45 |
| NG 1.x (Exalead) | 1 | 699.44 MB | 27 Jul 2010 - 15:51 |
| Speedy Spider | 97+357 | 1.81 MB | 27 Jul 2010 - 08:37 |
| FAST Enterprise Crawler | 178+11 | 1.77 MB | 26 Jul 2010 - 17:26 |
| SurveyBot | 3+3 | 34.64 KB | 26 Jul 2010 - 09:47 |
| WordPress | 4 | 14.76 KB | 26 Jul 2010 - 00:30 |
| Xenu Link Sleuth | 6 | 1.07 KB | 25 Jul 2010 - 23:27 |
| Powermarks | 2 | 15.27 KB | 25 Jul 2010 - 16:21 |
| VSE | 7 | 3.48 MB | 24 Jul 2010 - 20:25 |
| WallPaper (alias crawlpaper) | 1 | 1.70 MB | 24 Jul 2010 - 18:00 |
| Microsoft URL Control | 13 | 292.59 KB | 23 Jul 2010 - 03:58 |
| yacy | 0+3 | 936 Bytes | 22 Jul 2010 - 01:42 |
| Voyager | 0+1 | 331 Bytes | 19 Jul 2010 - 16:15 |
| Gaisbot | 0+1 | 369 Bytes | 18 Jul 2010 - 19:45 |
| Turn It In | 26+4 | 237.82 KB | 18 Jul 2010 - 16:04 |
| Fish search | 3 | 58.03 KB | 18 Jul 2010 - 12:49 |
| Ocelli | 18+1 | 119.15 KB | 18 Jul 2010 - 01:16 |
| ichiro | 2+4 | 13.41 KB | 17 Jul 2010 - 22:45 |
| Jakarta commons-httpclient | 38 | 211.66 KB | 17 Jul 2010 - 02:44 |
| BlogSearch | 0+1 | 331 Bytes | 16 Jul 2010 - 14:26 |
| LinkChecker | 1 | 17.77 KB | 15 Jul 2010 - 02:09 |
| Netcraft | 20 | 107.25 KB | 14 Jul 2010 - 05:36 |
| Heritrix | 0+1 | 331 Bytes | 12 Jul 2010 - 22:08 |
| mnoGoSearch search engine software | 1 | 11.22 KB | 12 Jul 2010 - 16:36 |
| larbin | 6+7 | 62.26 KB | 12 Jul 2010 - 16:35 |
| BBot | 1 | 701.55 KB | 10 Jul 2010 - 08:34 |
| Web Downloader | 1 | 43.05 KB | 09 Jul 2010 - 03:41 |
| Cursor | 1 | 2.83 KB | 04 Jul 2010 - 08:18 |