| 95 different robots | Hits | Bandwidth | Last visit |
|---|
| Load Balancing Server | 544174 | 1.04 GB | 30 Jun 2011 - 22:32 |
| Googlebot | 218076+377 | 9.16 GB | 30 Jun 2011 - 22:31 |
| Yahoo Slurp | 73863+428 | 12.65 GB | 30 Jun 2011 - 22:32 |
| Yandex bot | 38287+303 | 1.35 GB | 30 Jun 2011 - 22:31 |
| Unknown robot (identified by 'crawl') | 20025+8495 | 155.95 MB | 30 Jun 2011 - 22:18 |
| Nagios | 27127 | 78.27 MB | 30 Jun 2011 - 22:31 |
| Unknown robot (identified by 'robot') | 26121+134 | 286.23 MB | 30 Jun 2011 - 21:53 |
| Unknown robot (identified by 'bot/' or 'bot-') | 22371+1630 | 1.02 GB | 30 Jun 2011 - 22:04 |
| Unknown robot (identified by 'spider') | 20240+191 | 194.44 MB | 30 Jun 2011 - 21:50 |
| WebVac | 5834+1 | 32.12 MB | 07 Jun 2011 - 05:26 |
| MSNBot-media | 4322+1364 | 417.80 MB | 30 Jun 2011 - 22:10 |
| FAST Enterprise Crawler | 5095+19 | 20.35 MB | 30 Jun 2011 - 21:13 |
| MJ12bot | 3162+338 | 60.35 MB | 30 Jun 2011 - 21:20 |
| Voila | 2892+105 | 156.67 MB | 30 Jun 2011 - 21:52 |
| BaiDuSpider | 2711+154 | 102.78 MB | 30 Jun 2011 - 22:32 |
| Speedy Spider | 2430+332 | 32.63 MB | 30 Jun 2011 - 20:06 |
| Exabot | 2263+43 | 16.00 MB | 30 Jun 2011 - 22:29 |
| Python-urllib | 2134+6 | 1.94 GB | 30 Jun 2011 - 22:31 |
| Feedfetcher-Google | 2049 | 103.09 MB | 30 Jun 2011 - 22:15 |
| Java (Often spam bot) | 1885+3 | 579.18 MB | 30 Jun 2011 - 20:33 |
| WordPress | 972 | 7.00 MB | 30 Jun 2011 - 22:15 |
| Unknown robot (identified by hit on 'robots.txt') | 0+953 | 411.20 KB | 30 Jun 2011 - 20:37 |
| bender focused_crawler | 812+99 | 6.05 MB | 30 Jun 2011 - 19:36 |
| Nutch | 720+174 | 213.07 MB | 30 Jun 2011 - 20:32 |
| CFNetwork | 705 | 364.60 MB | 30 Jun 2011 - 20:27 |
| BSpider | 535+114 | 4.20 MB | 30 Jun 2011 - 22:00 |
| UP.Browser | 633 | 172.07 MB | 30 Jun 2011 - 20:52 |
| Alexa (IA Archiver) | 161+346 | 7.21 MB | 30 Jun 2011 - 21:37 |
| legs | 273+214 | 19.90 MB | 30 Jun 2011 - 21:42 |
| psbot | 420+46 | 3.38 MB | 29 Jun 2011 - 21:25 |
| Custo | 349+111 | 19.37 MB | 30 Jun 2011 - 07:11 |
| TencentTraveler | 456 | 133.06 MB | 30 Jun 2011 - 20:20 |
| Powermarks | 346 | 1.15 MB | 30 Jun 2011 - 19:34 |
| Motor | 343 | 25.76 MB | 30 Jun 2011 - 19:10 |
| Web Core / Roots | 337 | 389.57 MB | 30 Jun 2011 - 21:55 |
| Yahoo! Slurp China | 240+78 | 10.09 MB | 30 Jun 2011 - 14:50 |
| GigaBot | 195+110 | 525.21 KB | 29 Jun 2011 - 13:41 |
| DoCoMo | 268+35 | 6.98 MB | 30 Jun 2011 - 02:48 |
| MLBot | 202+71 | 2.88 MB | 30 Jun 2011 - 04:57 |
| Heritrix | 200+8 | 79.57 MB | 18 Jun 2011 - 09:52 |
| MSNBot | 145+47 | 1.04 MB | 30 Jun 2011 - 13:49 |
| MagpieRSS | 131+30 | 174.88 KB | 30 Jun 2011 - 16:19 |
| Ask | 115+38 | 8.57 MB | 30 Jun 2011 - 18:56 |
| Jakarta commons-httpclient | 100 | 13.80 MB | 30 Jun 2011 - 13:52 |
| WallPaper (alias crawlpaper) | 64 | 10.75 MB | 27 Jun 2011 - 18:45 |
| Findlinks | 27+34 | 229.64 KB | 27 Jun 2011 - 07:51 |
| larbin | 31+26 | 4.93 MB | 30 Jun 2011 - 21:49 |
| VORTEX | 54 | 8.31 MB | 30 Jun 2011 - 19:00 |
| archive.org bot | 49+4 | 5.29 MB | 27 Jun 2011 - 07:57 |
| HTTrack off-line browser | 29+21 | 26.06 MB | 30 Jun 2011 - 16:26 |
| Netcraft | 47 | 72.47 KB | 30 Jun 2011 - 08:22 |
| MSIECrawler | 8+32 | 50.22 KB | 30 Jun 2011 - 08:30 |
| VSE | 22 | 6.77 MB | 29 Jun 2011 - 13:46 |
| Google AdSense | 18+1 | 140.50 KB | 30 Jun 2011 - 03:31 |
| WebCollage | 18 | 289.51 KB | 30 Jun 2011 - 09:03 |
| HTMLParser | 17 | 241.89 KB | 28 Jun 2011 - 08:35 |
| SurveyBot | 12+2 | 46.78 KB | 26 Jun 2011 - 18:39 |
| JCrawler | 11+3 | 65.44 KB | 26 Jun 2011 - 22:49 |
| NG 1.x (Exalead) | 14 | 3.15 MB | 16 Jun 2011 - 06:00 |
| Xenu Link Sleuth | 14 | 4.02 KB | 30 Jun 2011 - 12:22 |
| gammaSpider, FocusedCrawler | 12 | 1.21 MB | 14 Jun 2011 - 04:15 |
| yacy | 5+7 | 1.58 MB | 30 Jun 2011 - 17:42 |
| Voyager | 10 | 689.53 KB | 29 Jun 2011 - 20:34 |
| Internet Shinchakubin | 9 | 343.15 KB | 16 Jun 2011 - 13:11 |
| SeznamBot | 4+4 | 9.88 KB | 22 Jun 2011 - 13:52 |
| Turn It In | 5+2 | 1.50 KB | 26 Jun 2011 - 03:18 |
| Y!J Yahoo Japan | 7 | 15.68 KB | 29 Jun 2011 - 15:14 |
| Microsoft URL Control | 6 | 1.47 MB | 24 Jun 2011 - 12:14 |
| EasyDL | 6 | 488.68 KB | 28 Jun 2011 - 20:51 |
| Boris | 6 | 353.88 KB | 03 Jun 2011 - 12:53 |
| LinkChecker | 3+2 | 10.87 KB | 30 Jun 2011 - 07:20 |
| BBot | 4 | 21.44 MB | 18 Jun 2011 - 03:41 |
| Web Downloader | 4 | 4.69 MB | 30 Jun 2011 - 00:35 |
| NetMechanic | 2+2 | 1.27 KB | 27 Jun 2011 - 02:14 |
| TITAN | 4 | 249.27 KB | 23 Jun 2011 - 22:49 |
| Pioneer | 3 | 175.40 KB | 24 Jun 2011 - 11:33 |
| W3C Validator | 2 | 3.47 KB | 25 Jun 2011 - 11:50 |
| Susie | 2 | 1.57 MB | 26 Jun 2011 - 05:44 |
| Fish search | 2 | 739.48 KB | 11 Jun 2011 - 02:06 |
| ichiro | 1+1 | 2.19 KB | 28 Jun 2011 - 14:42 |
| The web archive (IA Archiver) | 0+2 | 772 Bytes | 10 Jun 2011 - 13:56 |
| arks | 2 | 20.28 KB | 30 Jun 2011 - 17:52 |
| LinkWalker | 1 | 4.48 KB | 16 Jun 2011 - 12:04 |
| Z-Add Link Checker | 1 | 302 Bytes | 25 Jun 2011 - 22:26 |
| FavOrg | 1 | 3.63 KB | 23 Jun 2011 - 02:57 |
| InternetSeer | 1 | 3.59 KB | 06 Jun 2011 - 19:40 |
| Cursor | 1 | 4.36 KB | 03 Jun 2011 - 09:17 |
| StackRambler | 0+1 | 386 Bytes | 13 Jun 2011 - 04:08 |
| The World Wide Web Worm | 1 | 67.35 KB | 06 Jun 2011 - 17:36 |
| Sunrise | 1 | 1.56 MB | 01 Jun 2011 - 09:50 |
| UCSD Crawl | 1 | 100.46 KB | 30 Jun 2011 - 11:48 |
| BlogSearch | 0+1 | 351 Bytes | 20 Jun 2011 - 09:32 |
| W3C Link Checker | 1 | 3.04 KB | 27 Jun 2011 - 09:32 |
| Argus | 1 | 2.57 KB | 16 Jun 2011 - 16:07 |
| lwp-trivial | 0+1 | 386 Bytes | 08 Jun 2011 - 10:23 |