| 84 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 81781+65 | 6.07 GB | 31 Oct 2011 - 23:13 |
| Load Balancing Server | 80152 | 239.78 MB | 31 Oct 2011 - 23:13 |
| Unknown robot (identified by 'bot/' or 'bot-') | 60870+412 | 1.53 GB | 31 Oct 2011 - 23:13 |
| Yahoo Slurp | 43626+139 | 4.31 GB | 31 Oct 2011 - 21:15 |
| BaiDuSpider | 28824+21 | 357.51 MB | 31 Oct 2011 - 23:13 |
| Yandex bot | 22230+72 | 1.22 GB | 31 Oct 2011 - 23:13 |
| Unknown robot (identified by 'robot') | 18453+55 | 255.89 MB | 31 Oct 2011 - 19:24 |
| Nagios | 17612 | 30.26 MB | 31 Oct 2011 - 23:08 |
| Unknown robot (identified by 'crawl') | 6034+4980 | 72.52 MB | 31 Oct 2011 - 22:57 |
| WebVac | 5382+3 | 28.71 MB | 08 Oct 2011 - 06:53 |
| Unknown robot (identified by 'spider') | 3279+715 | 38.33 MB | 31 Oct 2011 - 22:08 |
| psbot | 3129+106 | 5.22 MB | 31 Oct 2011 - 22:27 |
| MJ12bot | 2889+220 | 48.67 MB | 31 Oct 2011 - 22:18 |
| Heritrix | 2911+3 | 31.89 MB | 25 Oct 2011 - 01:59 |
| Voila | 2665+72 | 174.72 MB | 31 Oct 2011 - 18:37 |
| Feedfetcher-Google | 2655 | 62.56 MB | 31 Oct 2011 - 23:05 |
| Speedy Spider | 2010+160 | 24.62 MB | 31 Oct 2011 - 22:49 |
| MSNBot-media | 1011+542 | 63.70 MB | 31 Oct 2011 - 22:22 |
| Exabot | 1363+25 | 14.59 MB | 31 Oct 2011 - 22:42 |
| WordPress | 862 | 22.94 MB | 31 Oct 2011 - 22:55 |
| Web Core / Roots | 611 | 316.96 MB | 31 Oct 2011 - 16:17 |
| Unknown robot (identified by hit on 'robots.txt') | 0+611 | 267.85 KB | 31 Oct 2011 - 22:33 |
| CFNetwork | 543 | 221.23 MB | 31 Oct 2011 - 19:02 |
| Java (Often spam bot) | 352+6 | 53.13 MB | 31 Oct 2011 - 21:57 |
| Nutch | 220+96 | 52.24 MB | 31 Oct 2011 - 09:59 |
| Python-urllib | 274+5 | 148.72 MB | 31 Oct 2011 - 22:31 |
| legs | 135+98 | 15.32 MB | 31 Oct 2011 - 10:55 |
| DoCoMo | 174+46 | 9.38 MB | 31 Oct 2011 - 14:47 |
| Alexa (IA Archiver) | 110+107 | 13.66 MB | 31 Oct 2011 - 13:00 |
| UP.Browser | 159 | 8.26 MB | 31 Oct 2011 - 22:24 |
| Yahoo! Slurp China | 87+67 | 2.87 MB | 20 Oct 2011 - 17:04 |
| bender focused_crawler | 148+5 | 1.42 MB | 31 Oct 2011 - 20:42 |
| MLBot | 109+21 | 1.34 MB | 31 Oct 2011 - 21:08 |
| Custo | 101+27 | 7.39 MB | 31 Oct 2011 - 15:44 |
| MagpieRSS | 108+13 | 8.48 KB | 31 Oct 2011 - 18:36 |
| Powermarks | 111 | 990.61 KB | 30 Oct 2011 - 08:03 |
| Jakarta commons-httpclient | 102 | 21.78 MB | 31 Oct 2011 - 22:12 |
| GigaBot | 38+45 | 187.89 KB | 28 Oct 2011 - 22:02 |
| HTMLParser | 79 | 597.03 KB | 29 Oct 2011 - 00:16 |
| SuperBot | 77 | 1.77 MB | 22 Oct 2011 - 03:56 |
| SeznamBot | 49+21 | 2.76 MB | 31 Oct 2011 - 21:22 |
| WallPaper (alias crawlpaper) | 60 | 5.22 MB | 31 Oct 2011 - 16:59 |
| BSpider | 40+13 | 2.24 MB | 31 Oct 2011 - 12:48 |
| ichiro | 46+5 | 2.02 MB | 29 Oct 2011 - 18:01 |
| TencentTraveler | 30 | 7.38 MB | 28 Oct 2011 - 03:10 |
| HTTrack off-line browser | 27+2 | 22.86 MB | 31 Oct 2011 - 07:12 |
| Xenu Link Sleuth | 29 | 128.53 KB | 28 Oct 2011 - 19:14 |
| Motor | 27+1 | 2.63 MB | 31 Oct 2011 - 13:28 |
| Ask | 11+17 | 307.75 KB | 26 Oct 2011 - 03:31 |
| Google AdSense | 23 | 705.36 KB | 31 Oct 2011 - 14:48 |
| MojeekBot | 7+16 | 40.06 KB | 29 Oct 2011 - 06:42 |
| VORTEX | 21 | 1.72 MB | 31 Oct 2011 - 00:15 |
| Findlinks | 7+12 | 43.71 KB | 30 Oct 2011 - 19:29 |
| NG 1.x (Exalead) | 18 | 1.07 MB | 20 Oct 2011 - 19:57 |
| WebCollage | 16 | 137.10 KB | 31 Oct 2011 - 11:00 |
| yacy | 9+6 | 2.06 MB | 25 Oct 2011 - 23:32 |
| MSNBot | 10+5 | 35.76 KB | 31 Oct 2011 - 08:50 |
| VSE | 15 | 2.05 MB | 31 Oct 2011 - 19:44 |
| larbin | 10+3 | 104.78 KB | 27 Oct 2011 - 17:07 |
| W3C Validator | 11 | 1.65 MB | 22 Oct 2011 - 18:32 |
| Netcraft | 10 | 41.27 KB | 31 Oct 2011 - 17:05 |
| W3C jigsaw CSS Validator | 10 | 106.37 KB | 22 Oct 2011 - 18:32 |
| Turn It In | 8+1 | 4.58 MB | 21 Oct 2011 - 00:41 |
| NetMechanic | 4+5 | 2.90 KB | 31 Oct 2011 - 02:15 |
| SurveyBot | 6 | 24.02 KB | 30 Oct 2011 - 04:42 |
| Y!J Yahoo Japan | 1+5 | 5.48 KB | 29 Oct 2011 - 04:43 |
| FeedValidator | 5 | 53.11 KB | 22 Oct 2011 - 18:32 |
| archive.org bot | 1+4 | 89.20 KB | 16 Oct 2011 - 11:27 |
| Fish search | 4 | 216.15 KB | 25 Oct 2011 - 01:42 |
| Sunrise | 4 | 150.77 KB | 16 Oct 2011 - 00:24 |
| MSIECrawler | 4 | 268.68 KB | 26 Oct 2011 - 11:51 |
| PhpDig | 1+1 | 602 Bytes | 27 Oct 2011 - 14:29 |
| W3C Link Checker | 1+1 | 708 Bytes | 20 Oct 2011 - 15:11 |
| LinkScan | 2 | 7.44 KB | 21 Oct 2011 - 02:14 |
| Microsoft URL Control | 1 | 215.29 KB | 01 Oct 2011 - 08:27 |
| Kevin | 1 | 686.26 KB | 19 Oct 2011 - 14:24 |
| Cursor | 1 | 33.13 KB | 11 Oct 2011 - 05:04 |
| Shoutcast Directory Service | 1 | 32.95 KB | 05 Oct 2011 - 08:54 |
| Vagabondo | 1 | 1.56 MB | 08 Oct 2011 - 19:42 |
| YahooSeeker Yahoo! Blog crawler | 1 | 3.06 KB | 12 Oct 2011 - 04:21 |
| Phantom | 1 | 174.83 KB | 28 Oct 2011 - 23:29 |
| Boris | 1 | 0 | 31 Oct 2011 - 14:04 |
| Combine System | 0+1 | 386 Bytes | 10 Oct 2011 - 05:14 |
| Voyager | 1 | 9.50 KB | 03 Oct 2011 - 09:48 |