| 97 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 395134+61 | 11.31 GB | 31 Aug 2010 - 23:43 |
| Yahoo Slurp | 84832+151 | 7.13 GB | 31 Aug 2010 - 23:42 |
| Load Balancing Server | 64120 | 800.55 MB | 31 Aug 2010 - 23:43 |
| Yandex bot | 53672+73 | 2.54 GB | 31 Aug 2010 - 23:43 |
| MSNBot | 23925+977 | 1.87 GB | 31 Aug 2010 - 23:39 |
| Unknown robot (identified by 'crawl') | 15837+5854 | 217.07 MB | 31 Aug 2010 - 23:24 |
| Nagios | 19567 | 52.16 MB | 31 Aug 2010 - 23:37 |
| MSNBot-media | 13796+3401 | 2.01 GB | 31 Aug 2010 - 23:41 |
| FAST Enterprise Crawler | 15071+49 | 911.78 MB | 31 Aug 2010 - 23:43 |
| Unknown robot (identified by 'bot/' or 'bot-') | 3932+945 | 268.23 MB | 31 Aug 2010 - 23:28 |
| Exabot | 4433+28 | 10.85 MB | 31 Aug 2010 - 23:41 |
| Voila | 2750+75 | 142.81 MB | 31 Aug 2010 - 23:28 |
| Ask | 2409+116 | 168.44 MB | 31 Aug 2010 - 23:25 |
| BaiDuSpider | 2132+166 | 461.14 MB | 31 Aug 2010 - 23:31 |
| Speedy Spider | 1978+308 | 26.33 MB | 31 Aug 2010 - 22:53 |
| Unknown robot (identified by 'spider') | 1136+795 | 50.78 MB | 31 Aug 2010 - 20:08 |
| CFNetwork | 1789 | 252.76 MB | 31 Aug 2010 - 21:51 |
| Unknown robot (identified by 'robot') | 1718+62 | 42.03 MB | 31 Aug 2010 - 22:49 |
| Ocelli | 1535+1 | 156.36 MB | 26 Aug 2010 - 00:41 |
| Heritrix | 1251+13 | 169.34 MB | 31 Aug 2010 - 18:31 |
| UP.Browser | 1146 | 334.50 MB | 31 Aug 2010 - 23:01 |
| psbot | 877+64 | 14.34 MB | 31 Aug 2010 - 11:52 |
| Feedfetcher-Google | 941 | 126.78 MB | 31 Aug 2010 - 22:19 |
| Java (Often spam bot) | 893+20 | 204.61 MB | 31 Aug 2010 - 22:31 |
| Unknown robot (identified by hit on 'robots.txt') | 0+912 | 374.23 KB | 31 Aug 2010 - 21:52 |
| Nutch | 480+28 | 4.32 MB | 27 Aug 2010 - 19:34 |
| WordPress | 431 | 2.16 MB | 31 Aug 2010 - 16:02 |
| Python-urllib | 394+2 | 344.12 MB | 31 Aug 2010 - 23:35 |
| Powermarks | 373 | 1.37 MB | 31 Aug 2010 - 16:07 |
| Fish search | 321 | 65.61 MB | 31 Aug 2010 - 22:22 |
| MSIECrawler | 142+177 | 1.63 MB | 31 Aug 2010 - 16:32 |
| Turn It In | 297+1 | 5.30 MB | 22 Aug 2010 - 16:32 |
| Alexa (IA Archiver) | 222+76 | 9.21 MB | 31 Aug 2010 - 20:52 |
| Custo | 214+44 | 15.28 MB | 31 Aug 2010 - 18:53 |
| Yahoo! Slurp China | 228+29 | 8.87 MB | 31 Aug 2010 - 15:02 |
| MJ12bot | 234+11 | 2.07 MB | 30 Aug 2010 - 22:59 |
| Jakarta commons-httpclient | 240+1 | 32.70 MB | 31 Aug 2010 - 20:48 |
| InfoBot | 220+2 | 4.10 MB | 31 Aug 2010 - 19:18 |
| MLBot | 171+34 | 2.33 MB | 31 Aug 2010 - 17:59 |
| The web archive (IA Archiver) | 26+145 | 850.44 KB | 31 Aug 2010 - 11:41 |
| Motor | 166 | 11.17 MB | 30 Aug 2010 - 21:00 |
| DoCoMo | 91+60 | 3.04 MB | 31 Aug 2010 - 17:49 |
| Web Core / Roots | 136 | 210.74 MB | 31 Aug 2010 - 21:37 |
| TencentTraveler | 131 | 28.58 MB | 31 Aug 2010 - 22:35 |
| yacy | 48+71 | 6.03 MB | 31 Aug 2010 - 12:22 |
| WebVac | 108+1 | 1.80 MB | 12 Aug 2010 - 17:21 |
| VSE | 90 | 13.69 MB | 31 Aug 2010 - 15:31 |
| HTTrack off-line browser | 62+12 | 19.46 MB | 31 Aug 2010 - 23:04 |
| GigaBot | 26+33 | 233.06 KB | 28 Aug 2010 - 11:32 |
| larbin | 30+23 | 1.02 MB | 31 Aug 2010 - 19:49 |
| Xenu Link Sleuth | 43 | 24.43 KB | 31 Aug 2010 - 12:27 |
| legs | 11+30 | 437.02 KB | 26 Aug 2010 - 10:07 |
| Google AdSense | 32 | 1.06 MB | 31 Aug 2010 - 10:36 |
| WebCollage | 21 | 932.40 KB | 29 Aug 2010 - 14:44 |
| SpiderMan | 8+13 | 485.51 KB | 31 Aug 2010 - 21:34 |
| Findlinks | 15+2 | 179.29 KB | 31 Aug 2010 - 21:41 |
| Gaisbot | 3+14 | 14.37 KB | 19 Aug 2010 - 03:23 |
| WallPaper (alias crawlpaper) | 16 | 148.28 KB | 27 Aug 2010 - 11:53 |
| BSpider | 2+12 | 580.54 KB | 29 Aug 2010 - 08:33 |
| EasyDL | 13 | 1.80 MB | 31 Aug 2010 - 11:12 |
| HTMLParser | 13 | 147.31 KB | 10 Aug 2010 - 14:16 |
| Y!J Yahoo Japan | 11+2 | 1.53 MB | 24 Aug 2010 - 06:19 |
| StackRambler | 12 | 98.58 KB | 07 Aug 2010 - 03:51 |
| Feedburner | 12 | 4.02 KB | 25 Aug 2010 - 10:08 |
| Digger | 4+7 | 242.18 KB | 25 Aug 2010 - 05:30 |
| ichiro | 7+4 | 43.41 KB | 11 Aug 2010 - 01:57 |
| SurveyBot | 10 | 95.93 KB | 30 Aug 2010 - 13:42 |
| BBot | 10 | 24.91 MB | 31 Aug 2010 - 11:16 |
| archive.org bot | 7+3 | 29.09 KB | 26 Aug 2010 - 21:47 |
| Microsoft URL Control | 9 | 113.29 KB | 22 Aug 2010 - 20:30 |
| Voyager | 8+1 | 70.24 KB | 25 Aug 2010 - 22:45 |
| Webdup | 6 | 12.27 KB | 31 Aug 2010 - 01:46 |
| Netcraft | 6 | 37.28 KB | 13 Aug 2010 - 13:02 |
| TITAN | 5 | 77.97 KB | 21 Aug 2010 - 00:06 |
| W3C Validator | 4 | 2.82 KB | 12 Aug 2010 - 15:22 |
| XYLEME Robot | 4 | 132.66 KB | 29 Aug 2010 - 10:39 |
| Vagabondo | 0+4 | 1.51 KB | 14 Aug 2010 - 00:53 |
| DNAbot | 2+1 | 63.92 KB | 10 Aug 2010 - 14:35 |
| Cursor | 3 | 132.77 KB | 22 Aug 2010 - 09:01 |
| Susie | 2 | 221.16 KB | 23 Aug 2010 - 15:50 |
| WebReaper | 0+2 | 848 Bytes | 31 Aug 2010 - 23:38 |
| YahooSeeker Yahoo! Blog crawler | 0+2 | 772 Bytes | 12 Aug 2010 - 23:17 |
| Tcl http client package | 2 | 201.46 KB | 27 Aug 2010 - 15:25 |
| W3C Link Checker | 0+2 | 848 Bytes | 11 Aug 2010 - 13:56 |
| arks | 2 | 27.31 KB | 21 Aug 2010 - 09:38 |
| UdmSearch | 1 | 203.57 KB | 03 Aug 2010 - 01:08 |
| SuperBot | 1 | 794 Bytes | 11 Aug 2010 - 16:39 |
| Ingrid | 1 | 113.85 KB | 18 Aug 2010 - 05:13 |
| FavOrg | 1 | 18.87 KB | 02 Aug 2010 - 10:00 |
| The World Wide Web Worm | 1 | 203.57 KB | 18 Aug 2010 - 15:20 |
| Web Downloader | 1 | 2.16 KB | 04 Aug 2010 - 14:20 |
| NG 1.x (Exalead) | 1 | 14.49 KB | 30 Aug 2010 - 14:02 |
| LinkChecker | 1 | 203.52 KB | 30 Aug 2010 - 13:26 |
| Combine System | 1 | 21.27 KB | 07 Aug 2010 - 18:16 |
| Scooter | 1 | 3.63 KB | 22 Aug 2010 - 14:55 |
| Bookmark-Manager | 1 | 303 Bytes | 03 Aug 2010 - 13:36 |
| lwp-trivial | 1 | 129.16 KB | 31 Aug 2010 - 02:58 |