| 57 different robots | Hits | Bandwidth | Last visit |
|---|
| Load Balancing Server | 394834 | 691.12 MB | 30 Apr 2011 - 23:59 |
| Googlebot | 128233+201 | 540.30 MB | 30 Apr 2011 - 23:59 |
| Unknown robot (identified by 'crawl') | 7429+2671 | 9.04 MB | 30 Apr 2011 - 23:36 |
| Yahoo Slurp | 4574+226 | 476.94 MB | 30 Apr 2011 - 23:50 |
| Python-urllib | 3525 | 1.51 GB | 30 Apr 2011 - 23:51 |
| Unknown robot (identified by 'bot/' or 'bot-') | 979+2358 | 34.27 MB | 30 Apr 2011 - 23:29 |
| Unknown robot (identified by 'robot') | 1825+48 | 6.11 MB | 30 Apr 2011 - 01:22 |
| BaiDuSpider | 1484+241 | 7.52 MB | 30 Apr 2011 - 23:28 |
| Yandex bot | 1235+182 | 12.86 MB | 30 Apr 2011 - 22:16 |
| Unknown robot (identified by hit on 'robots.txt') | 0+391 | 163.46 KB | 30 Apr 2011 - 23:13 |
| MJ12bot | 239+128 | 11.55 MB | 30 Apr 2011 - 23:18 |
| Unknown robot (identified by 'spider') | 302+52 | 3.35 MB | 30 Apr 2011 - 23:33 |
| MLBot | 228+70 | 1.96 MB | 30 Apr 2011 - 22:16 |
| Nutch | 169+13 | 2.80 MB | 29 Apr 2011 - 00:57 |
| Java (Often spam bot) | 146+1 | 139.28 MB | 28 Apr 2011 - 14:24 |
| HTTrack off-line browser | 117+13 | 4.58 MB | 28 Apr 2011 - 11:36 |
| Speedy Spider | 69+61 | 829.12 KB | 30 Apr 2011 - 21:41 |
| BSpider | 97+18 | 4.65 MB | 30 Apr 2011 - 21:31 |
| MSNBot-media | 57+34 | 1.31 MB | 30 Apr 2011 - 12:44 |
| Yahoo! Slurp China | 17+63 | 54.43 KB | 30 Apr 2011 - 20:06 |
| Voila | 39+26 | 2.21 MB | 29 Apr 2011 - 01:41 |
| ichiro | 16+39 | 85.87 KB | 28 Apr 2011 - 12:19 |
| Heritrix | 49+4 | 209.64 KB | 27 Apr 2011 - 21:18 |
| Custo | 29+23 | 2.27 MB | 29 Apr 2011 - 21:30 |
| Exabot | 21+12 | 100.68 KB | 30 Apr 2011 - 21:43 |
| FAST Enterprise Crawler | 25+1 | 220.25 KB | 25 Apr 2011 - 18:33 |
| larbin | 15+11 | 63.74 KB | 30 Apr 2011 - 08:30 |
| DoCoMo | 2+23 | 12.18 KB | 30 Apr 2011 - 08:27 |
| Findlinks | 9+16 | 59.50 KB | 29 Apr 2011 - 11:42 |
| WordPress | 22 | 22.31 KB | 15 Apr 2011 - 02:02 |
| Steeler | 20+1 | 805.90 KB | 11 Apr 2011 - 16:44 |
| Netcraft | 19 | 59.76 KB | 30 Apr 2011 - 19:24 |
| GigaBot | 7+10 | 19.53 KB | 27 Apr 2011 - 21:28 |
| HTMLParser | 15 | 4.14 MB | 17 Apr 2011 - 10:38 |
| Web Core / Roots | 11 | 14.20 MB | 26 Apr 2011 - 18:14 |
| Sunrise | 9 | 86.24 KB | 28 Apr 2011 - 20:19 |
| SuperBot | 9 | 20.26 KB | 18 Apr 2011 - 04:28 |
| Alexa (IA Archiver) | 4+5 | 31.91 KB | 27 Apr 2011 - 09:13 |
| The web archive (IA Archiver) | 0+8 | 2.74 KB | 28 Apr 2011 - 22:52 |
| SeznamBot | 3+3 | 7.08 KB | 21 Apr 2011 - 09:02 |
| Digger | 6 | 24.76 KB | 25 Apr 2011 - 20:13 |
| archive.org bot | 4+2 | 22.60 KB | 29 Apr 2011 - 05:52 |
| Turn It In | 4+1 | 23.04 KB | 17 Apr 2011 - 01:45 |
| Xenu Link Sleuth | 5 | 1.03 KB | 29 Apr 2011 - 09:29 |
| Microsoft URL Control | 4 | 1.43 MB | 21 Apr 2011 - 08:49 |
| TencentTraveler | 4 | 19.27 KB | 14 Apr 2011 - 03:14 |
| CFNetwork | 4 | 130.82 MB | 24 Apr 2011 - 13:51 |
| yacy | 1+3 | 3.32 KB | 25 Apr 2011 - 15:30 |
| JBot Java Web Robot | 2 | 81.55 KB | 03 Apr 2011 - 04:32 |
| SurveyBot | 1+1 | 2.33 KB | 12 Apr 2011 - 04:33 |
| legs | 0+2 | 778 Bytes | 30 Apr 2011 - 16:42 |
| MSIECrawler | 0+2 | 740 Bytes | 09 Apr 2011 - 12:26 |
| LinkWalker | 1 | 4.22 KB | 14 Apr 2011 - 04:42 |
| Combine System | 1 | 302 Bytes | 04 Apr 2011 - 21:42 |
| UP.Browser | 1 | 701.55 KB | 14 Apr 2011 - 19:18 |
| BlogSearch | 0+1 | 351 Bytes | 19 Apr 2011 - 14:54 |
| StackRambler | 0+1 | 351 Bytes | 02 Apr 2011 - 18:20 |