| 91 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 627787+264 | 11.80 GB | 30 Apr 2011 - 23:59 |
| Load Balancing Server | 469252 | 1.58 GB | 30 Apr 2011 - 23:59 |
| Yahoo Slurp | 68253+397 | 7.65 GB | 30 Apr 2011 - 23:59 |
| Yandex bot | 49243+268 | 2.23 GB | 30 Apr 2011 - 23:59 |
| Unknown robot (identified by 'bot/' or 'bot-') | 44501+4153 | 1.25 GB | 30 Apr 2011 - 23:59 |
| Unknown robot (identified by 'crawl') | 17371+7855 | 104.40 MB | 30 Apr 2011 - 23:36 |
| Unknown robot (identified by 'robot') | 7528+107 | 74.40 MB | 30 Apr 2011 - 17:49 |
| FAST Enterprise Crawler | 6500+14 | 53.40 MB | 30 Apr 2011 - 23:58 |
| WebVac | 5614+1 | 29.18 MB | 08 Apr 2011 - 00:35 |
| MSNBot-media | 4192+1151 | 944.56 MB | 30 Apr 2011 - 23:58 |
| Unknown robot (identified by 'spider') | 4394+184 | 84.02 MB | 30 Apr 2011 - 23:51 |
| Python-urllib | 3997+127 | 1.76 GB | 30 Apr 2011 - 23:51 |
| Java (Often spam bot) | 3915+1 | 613.97 MB | 30 Apr 2011 - 20:32 |
| BaiDuSpider | 2802+333 | 67.92 MB | 30 Apr 2011 - 23:28 |
| MJ12bot | 2735+285 | 53.36 MB | 30 Apr 2011 - 23:26 |
| Voila | 2045+89 | 115.70 MB | 30 Apr 2011 - 23:23 |
| Speedy Spider | 1872+257 | 31.73 MB | 30 Apr 2011 - 22:40 |
| Exabot | 2064+30 | 18.65 MB | 30 Apr 2011 - 23:55 |
| Motor | 1805 | 173.28 MB | 30 Apr 2011 - 23:29 |
| CFNetwork | 1306 | 433.27 MB | 30 Apr 2011 - 21:50 |
| Nutch | 1220+75 | 45.73 MB | 30 Apr 2011 - 23:05 |
| Fish search | 1258 | 22.69 MB | 30 Apr 2011 - 23:47 |
| Feedfetcher-Google | 1255 | 100.15 MB | 30 Apr 2011 - 23:31 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1135 | 476.11 KB | 30 Apr 2011 - 23:13 |
| Heritrix | 982+11 | 175.95 MB | 27 Apr 2011 - 21:18 |
| UP.Browser | 983 | 288.87 MB | 30 Apr 2011 - 22:17 |
| WordPress | 980 | 10.94 MB | 30 Apr 2011 - 23:15 |
| MLBot | 650+107 | 7.91 MB | 30 Apr 2011 - 22:16 |
| Powermarks | 406 | 319.26 KB | 29 Apr 2011 - 16:10 |
| Custo | 315+64 | 19.01 MB | 30 Apr 2011 - 21:14 |
| Web Core / Roots | 348 | 290.26 MB | 30 Apr 2011 - 20:21 |
| BSpider | 315+23 | 6.03 MB | 30 Apr 2011 - 22:34 |
| bender focused_crawler | 301+30 | 19.47 MB | 30 Apr 2011 - 23:17 |
| Yahoo! Slurp China | 242+88 | 8.66 MB | 30 Apr 2011 - 23:14 |
| HTMLParser | 330 | 20.55 MB | 30 Apr 2011 - 05:05 |
| MSNBot | 279+41 | 3.54 MB | 30 Apr 2011 - 04:13 |
| GigaBot | 197+122 | 593.62 KB | 30 Apr 2011 - 15:35 |
| Alexa (IA Archiver) | 162+109 | 9.90 MB | 30 Apr 2011 - 10:57 |
| The web archive (IA Archiver) | 1+266 | 109.54 KB | 30 Apr 2011 - 20:20 |
| ichiro | 186+74 | 9.12 MB | 30 Apr 2011 - 21:13 |
| Jakarta commons-httpclient | 234 | 37.82 MB | 30 Apr 2011 - 22:55 |
| legs | 146+84 | 8.81 MB | 30 Apr 2011 - 16:42 |
| HTTrack off-line browser | 184+14 | 12.28 MB | 30 Apr 2011 - 23:32 |
| WallPaper (alias crawlpaper) | 187 | 37.08 MB | 30 Apr 2011 - 23:59 |
| DoCoMo | 97+59 | 4.12 MB | 30 Apr 2011 - 16:36 |
| TencentTraveler | 132 | 6.13 MB | 30 Apr 2011 - 23:55 |
| VORTEX | 98 | 7.55 MB | 30 Apr 2011 - 23:55 |
| larbin | 55+42 | 454.90 KB | 30 Apr 2011 - 11:19 |
| MagpieRSS | 68+19 | 7.87 KB | 30 Apr 2011 - 15:43 |
| VSE | 73 | 31.06 MB | 29 Apr 2011 - 09:37 |
| archive.org bot | 58+9 | 6.58 MB | 29 Apr 2011 - 05:52 |
| psbot | 41+12 | 7.01 MB | 25 Apr 2011 - 13:04 |
| WebCollage | 51 | 2.68 MB | 29 Apr 2011 - 13:50 |
| Findlinks | 20+26 | 201.00 KB | 30 Apr 2011 - 22:29 |
| Steeler | 30+2 | 890.46 KB | 11 Apr 2011 - 16:44 |
| Google AdSense | 32 | 949.87 KB | 26 Apr 2011 - 22:32 |
| Netcraft | 28 | 100.20 KB | 30 Apr 2011 - 19:24 |
| Ask | 25+1 | 1.86 MB | 23 Apr 2011 - 00:49 |
| MSIECrawler | 15+10 | 495.75 KB | 29 Apr 2011 - 09:03 |
| Xenu Link Sleuth | 23 | 18.81 KB | 29 Apr 2011 - 09:29 |
| Voyager | 20 | 905.93 KB | 29 Apr 2011 - 16:55 |
| Digger | 14 | 105.25 KB | 25 Apr 2011 - 20:13 |
| SurveyBot | 13+1 | 45.84 KB | 26 Apr 2011 - 21:02 |
| EasyDL | 13 | 1.38 MB | 30 Apr 2011 - 06:51 |
| yacy | 4+7 | 1.58 MB | 25 Apr 2011 - 15:30 |
| Microsoft URL Control | 10 | 1.65 MB | 27 Apr 2011 - 07:09 |
| gammaSpider, FocusedCrawler | 10 | 1.01 MB | 09 Apr 2011 - 04:19 |
| Turn It In | 9+1 | 23.85 KB | 22 Apr 2011 - 03:42 |
| SuperBot | 9 | 20.26 KB | 18 Apr 2011 - 04:28 |
| Sunrise | 9 | 86.24 KB | 28 Apr 2011 - 20:19 |
| LinkChecker | 5+3 | 170.76 KB | 20 Apr 2011 - 13:48 |
| Y!J Yahoo Japan | 6+2 | 4.12 KB | 26 Apr 2011 - 21:19 |
| NetMechanic | 3+4 | 2.27 KB | 25 Apr 2011 - 02:14 |
| NG 1.x (Exalead) | 7 | 131.67 KB | 26 Apr 2011 - 20:39 |
| SeznamBot | 3+3 | 7.08 KB | 21 Apr 2011 - 09:02 |
| arks | 3 | 911 Bytes | 15 Apr 2011 - 15:40 |
| JBot Java Web Robot | 2 | 81.55 KB | 03 Apr 2011 - 04:32 |
| W3C Validator | 2 | 14.96 KB | 25 Apr 2011 - 15:15 |
| StackRambler | 0+2 | 737 Bytes | 27 Apr 2011 - 10:29 |
| LinkWalker | 1 | 4.22 KB | 14 Apr 2011 - 04:42 |
| Z-Add Link Checker | 1 | 302 Bytes | 10 Apr 2011 - 04:21 |
| FavOrg | 1 | 14.59 KB | 04 Apr 2011 - 21:20 |
| Grub.org | 1 | 2.57 KB | 13 Apr 2011 - 12:38 |
| Digital Integrity Robot | 1 | 2.85 KB | 19 Apr 2011 - 08:00 |
| Muncher | 1 | 22.02 KB | 16 Apr 2011 - 15:55 |
| Vagabondo | 0+1 | 386 Bytes | 28 Apr 2011 - 09:51 |
| NutchCVS | 0+1 | 386 Bytes | 06 Apr 2011 - 14:10 |
| Combine System | 1 | 302 Bytes | 04 Apr 2011 - 21:42 |
| mnoGoSearch search engine software | 1 | 934 Bytes | 26 Apr 2011 - 11:35 |
| BlogSearch | 0+1 | 351 Bytes | 19 Apr 2011 - 14:54 |
| Link Valet Online | 1 | 303 Bytes | 20 Apr 2011 - 16:21 |