| 100 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 521247+300 | 11.68 GB | 31 Aug 2010 - 23:43 |
| Load Balancing Server | 308721 | 1.39 GB | 31 Aug 2010 - 23:44 |
| Yahoo Slurp | 92401+483 | 8.27 GB | 31 Aug 2010 - 23:42 |
| Yandex bot | 54700+201 | 2.55 GB | 31 Aug 2010 - 23:43 |
| Nagios | 34844 | 230.07 MB | 31 Aug 2010 - 23:40 |
| Unknown robot (identified by 'crawl') | 25503+8865 | 255.05 MB | 31 Aug 2010 - 23:24 |
| MSNBot | 25015+2535 | 1.92 GB | 31 Aug 2010 - 23:39 |
| MSNBot-media | 14165+4469 | 2.05 GB | 31 Aug 2010 - 23:41 |
| FAST Enterprise Crawler | 15274+66 | 914.41 MB | 31 Aug 2010 - 23:43 |
| Python-urllib | 12360+2 | 5.04 GB | 31 Aug 2010 - 23:35 |
| Unknown robot (identified by 'bot/' or 'bot-') | 5031+1053 | 296.44 MB | 31 Aug 2010 - 23:28 |
| Exabot | 4493+58 | 11.32 MB | 31 Aug 2010 - 23:41 |
| BaiDuSpider | 3551+461 | 1.07 GB | 31 Aug 2010 - 23:31 |
| Unknown robot (identified by 'robot') | 2949+109 | 55.32 MB | 31 Aug 2010 - 22:49 |
| Voila | 2859+116 | 144.80 MB | 31 Aug 2010 - 23:39 |
| Speedy Spider | 2066+628 | 28.69 MB | 31 Aug 2010 - 22:53 |
| Ask | 2495+170 | 170.53 MB | 31 Aug 2010 - 23:25 |
| Unknown robot (identified by 'spider') | 1483+909 | 56.67 MB | 31 Aug 2010 - 20:08 |
| CFNetwork | 1866 | 1.37 GB | 31 Aug 2010 - 21:51 |
| Ocelli | 1553+2 | 156.48 MB | 30 Aug 2010 - 18:55 |
| Java (Often spam bot) | 1412+23 | 322.20 MB | 31 Aug 2010 - 22:31 |
| Heritrix | 1313+18 | 169.67 MB | 31 Aug 2010 - 18:31 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1165 | 456.11 KB | 31 Aug 2010 - 21:52 |
| UP.Browser | 1157 | 334.93 MB | 31 Aug 2010 - 23:01 |
| psbot | 881+69 | 14.46 MB | 31 Aug 2010 - 11:52 |
| Feedfetcher-Google | 941 | 126.78 MB | 31 Aug 2010 - 22:19 |
| MLBot | 515+75 | 6.11 MB | 31 Aug 2010 - 17:59 |
| Nutch | 502+41 | 4.86 MB | 31 Aug 2010 - 20:57 |
| WordPress | 436 | 2.16 MB | 31 Aug 2010 - 16:02 |
| Powermarks | 377 | 1.66 MB | 31 Aug 2010 - 16:24 |
| MJ12bot | 296+64 | 2.78 MB | 31 Aug 2010 - 21:24 |
| MSIECrawler | 154+191 | 2.05 MB | 31 Aug 2010 - 16:32 |
| Yahoo! Slurp China | 245+83 | 8.98 MB | 31 Aug 2010 - 22:58 |
| Alexa (IA Archiver) | 228+98 | 9.95 MB | 31 Aug 2010 - 20:52 |
| Fish search | 323 | 65.64 MB | 31 Aug 2010 - 22:22 |
| Custo | 251+65 | 134.69 MB | 31 Aug 2010 - 18:53 |
| Turn It In | 297+1 | 5.30 MB | 22 Aug 2010 - 16:32 |
| Web Core / Roots | 241 | 307.97 MB | 31 Aug 2010 - 21:37 |
| Jakarta commons-httpclient | 240+1 | 32.70 MB | 31 Aug 2010 - 20:48 |
| InfoBot | 220+2 | 4.10 MB | 31 Aug 2010 - 19:18 |
| DoCoMo | 103+82 | 3.13 MB | 31 Aug 2010 - 17:49 |
| The web archive (IA Archiver) | 26+149 | 851.73 KB | 31 Aug 2010 - 11:41 |
| Motor | 169 | 11.20 MB | 30 Aug 2010 - 21:00 |
| TencentTraveler | 139 | 36.45 MB | 31 Aug 2010 - 22:35 |
| yacy | 49+78 | 6.05 MB | 31 Aug 2010 - 12:22 |
| WebVac | 108+1 | 1.80 MB | 12 Aug 2010 - 17:21 |
| VSE | 91 | 13.74 MB | 31 Aug 2010 - 15:31 |
| HTTrack off-line browser | 64+25 | 19.74 MB | 31 Aug 2010 - 23:04 |
| larbin | 38+31 | 1.10 MB | 31 Aug 2010 - 19:49 |
| GigaBot | 26+33 | 233.06 KB | 28 Aug 2010 - 11:32 |
| Findlinks | 53+3 | 430.01 KB | 31 Aug 2010 - 21:41 |
| legs | 12+36 | 1.11 MB | 26 Aug 2010 - 10:07 |
| Xenu Link Sleuth | 46 | 25.16 KB | 31 Aug 2010 - 12:27 |
| BSpider | 2+40 | 590.63 KB | 31 Aug 2010 - 06:36 |
| Netcraft | 32 | 146.43 KB | 13 Aug 2010 - 13:02 |
| Google AdSense | 32 | 1.06 MB | 31 Aug 2010 - 10:36 |
| WebCollage | 27 | 979.74 KB | 29 Aug 2010 - 14:44 |
| SpiderMan | 9+14 | 487.65 KB | 31 Aug 2010 - 21:34 |
| Gaisbot | 4+15 | 15.23 KB | 19 Aug 2010 - 03:23 |
| Voyager | 11+6 | 105.53 KB | 25 Aug 2010 - 22:45 |
| SurveyBot | 14+2 | 120.65 KB | 30 Aug 2010 - 13:42 |
| BBot | 16 | 26.14 MB | 31 Aug 2010 - 11:16 |
| WallPaper (alias crawlpaper) | 16 | 148.28 KB | 27 Aug 2010 - 11:53 |
| EasyDL | 14 | 1.80 MB | 31 Aug 2010 - 11:12 |
| Digger | 6+7 | 255.55 KB | 25 Aug 2010 - 05:30 |
| StackRambler | 12+1 | 98.91 KB | 07 Aug 2010 - 03:51 |
| HTMLParser | 13 | 147.31 KB | 10 Aug 2010 - 14:16 |
| Y!J Yahoo Japan | 11+2 | 1.53 MB | 24 Aug 2010 - 06:19 |
| Feedburner | 12 | 4.02 KB | 25 Aug 2010 - 10:08 |
| Microsoft URL Control | 11 | 139.24 KB | 25 Aug 2010 - 22:39 |
| ichiro | 7+4 | 43.41 KB | 11 Aug 2010 - 01:57 |
| archive.org bot | 7+3 | 29.09 KB | 26 Aug 2010 - 21:47 |
| Webdup | 6 | 12.27 KB | 31 Aug 2010 - 01:46 |
| W3C Link Checker | 2+4 | 2.14 KB | 23 Aug 2010 - 09:36 |
| TITAN | 5 | 77.97 KB | 21 Aug 2010 - 00:06 |
| W3C Validator | 4 | 2.82 KB | 12 Aug 2010 - 15:22 |
| XYLEME Robot | 4 | 132.66 KB | 29 Aug 2010 - 10:39 |
| Vagabondo | 0+4 | 1.51 KB | 14 Aug 2010 - 00:53 |
| YahooSeeker Yahoo! Blog crawler | 0+4 | 1.40 KB | 12 Aug 2010 - 23:17 |
| DNAbot | 2+1 | 63.92 KB | 10 Aug 2010 - 14:35 |
| Cursor | 3 | 132.77 KB | 22 Aug 2010 - 09:01 |
| arks | 3 | 44.35 KB | 25 Aug 2010 - 16:52 |
| Susie | 2 | 221.16 KB | 23 Aug 2010 - 15:50 |
| WebReaper | 0+2 | 848 Bytes | 31 Aug 2010 - 23:38 |
| Tcl http client package | 2 | 201.46 KB | 27 Aug 2010 - 15:25 |
| UdmSearch | 1 | 203.57 KB | 03 Aug 2010 - 01:08 |
| SuperBot | 1 | 794 Bytes | 11 Aug 2010 - 16:39 |
| Ingrid | 1 | 113.85 KB | 18 Aug 2010 - 05:13 |
| FavOrg | 1 | 18.87 KB | 02 Aug 2010 - 10:00 |
| Internet Shinchakubin | 1 | 832 Bytes | 23 Aug 2010 - 03:12 |
| The World Wide Web Worm | 1 | 203.57 KB | 18 Aug 2010 - 15:20 |
| Web Downloader | 1 | 2.16 KB | 04 Aug 2010 - 14:20 |
| NG 1.x (Exalead) | 1 | 14.49 KB | 30 Aug 2010 - 14:02 |
| Sunrise | 1 | 43.17 KB | 03 Aug 2010 - 18:10 |
| LinkChecker | 1 | 203.52 KB | 30 Aug 2010 - 13:26 |
| Combine System | 1 | 21.27 KB | 07 Aug 2010 - 18:16 |
| Scooter | 1 | 3.63 KB | 22 Aug 2010 - 14:55 |
| Bookmark-Manager | 1 | 303 Bytes | 03 Aug 2010 - 13:36 |
| BlogSearch | 0+1 | 331 Bytes | 15 Aug 2010 - 21:27 |
| lwp-trivial | 1 | 129.16 KB | 31 Aug 2010 - 02:58 |