| 101 different robots | Hits | Bandwidth | Last visit |
|---|
| Load Balancing Server | 1265597 | 10.84 GB | 31 Aug 2009 - 23:38 |
| MSNBot | 912371+2120 | 49.09 GB | 31 Aug 2009 - 23:38 |
| MLBot | 407644+47 | 2.71 GB | 31 Aug 2009 - 23:38 |
| Googlebot | 108241+56 | 8.03 GB | 31 Aug 2009 - 23:35 |
| Unknown robot (identified by 'robot') | 81834+96 | 1.11 GB | 31 Aug 2009 - 23:38 |
| Yahoo Slurp | 76173+217 | 11.21 GB | 31 Aug 2009 - 23:37 |
| Java (Often spam bot) | 74699+6 | 3.68 GB | 31 Aug 2009 - 23:38 |
| FAST Enterprise Crawler | 62424+36 | 2.15 GB | 31 Aug 2009 - 23:36 |
| Nagios | 27317 | 139.20 MB | 31 Aug 2009 - 23:35 |
| Unknown robot (identified by 'crawl') | 17097+1914 | 373.33 MB | 31 Aug 2009 - 23:37 |
| Heritrix | 12980+1692 | 93.94 MB | 31 Aug 2009 - 23:38 |
| Yahoo-MMCrawler | 14266+8 | 5.05 GB | 31 Aug 2009 - 23:38 |
| Unknown robot (identified by 'spider') | 5526+1125 | 45.26 MB | 31 Aug 2009 - 23:37 |
| Unknown robot (identified by hit on 'robots.txt') | 0+5462 | 2.01 MB | 31 Aug 2009 - 23:28 |
| BaiDuSpider | 5263+86 | 827.41 MB | 31 Aug 2009 - 23:25 |
| Voila | 5122+39 | 94.36 MB | 31 Aug 2009 - 23:02 |
| Exabot | 4801+26 | 10.27 MB | 31 Aug 2009 - 23:35 |
| yacy | 4666+30 | 2.39 GB | 31 Aug 2009 - 08:56 |
| Ask | 3768+137 | 273.94 MB | 31 Aug 2009 - 23:22 |
| VSE | 3840 | 1.38 GB | 31 Aug 2009 - 17:08 |
| MJ12bot | 3502+10 | 84.35 MB | 31 Aug 2009 - 14:39 |
| Unknown robot (identified by 'bot/' or 'bot-') | 2212+125 | 55.10 MB | 31 Aug 2009 - 20:20 |
| psbot | 1792+106 | 11.57 MB | 31 Aug 2009 - 23:13 |
| GigaBot | 1171+215 | 8.76 MB | 31 Aug 2009 - 23:33 |
| Yandex bot | 953+66 | 15.07 MB | 31 Aug 2009 - 16:57 |
| Speedy Spider | 797+67 | 13.38 MB | 31 Aug 2009 - 22:59 |
| Python-urllib | 650+91 | 189.27 MB | 31 Aug 2009 - 19:13 |
| Powermarks | 704 | 1.14 MB | 31 Aug 2009 - 23:20 |
| Custo | 567+132 | 45.06 MB | 31 Aug 2009 - 17:20 |
| Turn It In | 681+1 | 18.30 MB | 17 Aug 2009 - 00:55 |
| larbin | 619+63 | 500.52 MB | 31 Aug 2009 - 03:39 |
| CFNetwork | 663 | 1.89 GB | 31 Aug 2009 - 23:25 |
| Nutch | 514+142 | 37.25 MB | 31 Aug 2009 - 23:07 |
| Alexa (IA Archiver) | 530+78 | 16.85 MB | 31 Aug 2009 - 19:33 |
| LiveJournal.com | 555 | 21.55 MB | 31 Aug 2009 - 23:30 |
| TencentTraveler | 493 | 39.94 MB | 31 Aug 2009 - 22:33 |
| The web archive (IA Archiver) | 0+469 | 176.79 KB | 31 Aug 2009 - 06:26 |
| Yahoo! Slurp China | 397+44 | 13.04 MB | 31 Aug 2009 - 01:44 |
| Jakarta commons-httpclient | 361+14 | 44.98 MB | 31 Aug 2009 - 19:54 |
| UP.Browser | 340 | 26.83 MB | 31 Aug 2009 - 21:14 |
| UniversalFeedParser | 277 | 0 | 31 Aug 2009 - 22:53 |
| Ocelli | 250+2 | 2.08 MB | 22 Aug 2009 - 14:46 |
| WebVac | 247+1 | 4.07 MB | 08 Aug 2009 - 05:23 |
| Feedfetcher-Google | 242 | 1.05 MB | 31 Aug 2009 - 19:26 |
| InfoBot | 222+11 | 4.39 MB | 30 Aug 2009 - 10:19 |
| lwp-trivial | 218 | 12.69 MB | 11 Aug 2009 - 17:01 |
| Lycos | 133+24 | 23.73 MB | 31 Aug 2009 - 14:56 |
| WebCollage | 154 | 14.08 MB | 31 Aug 2009 - 15:17 |
| WordPress | 127 | 3.01 MB | 28 Aug 2009 - 10:40 |
| legs | 28+56 | 12.69 MB | 31 Aug 2009 - 19:31 |
| Web Core / Roots | 73 | 79.40 MB | 31 Aug 2009 - 04:16 |
| MSIECrawler | 50+12 | 833.45 KB | 31 Aug 2009 - 05:06 |
| DoCoMo | 52+2 | 1.57 MB | 30 Aug 2009 - 10:34 |
| Gaisbot | 41+12 | 2.00 MB | 28 Aug 2009 - 15:34 |
| Google AdSense | 52 | 577.93 KB | 29 Aug 2009 - 23:21 |
| MojeekBot | 49+2 | 342.90 KB | 24 Aug 2009 - 21:13 |
| Grub.org | 50 | 23.08 KB | 31 Aug 2009 - 19:11 |
| Xenu Link Sleuth | 49 | 13.60 KB | 30 Aug 2009 - 22:24 |
| BlogSearch | 47 | 1.63 MB | 31 Aug 2009 - 13:25 |
| LinkWalker | 27+19 | 156.87 KB | 31 Aug 2009 - 23:23 |
| HTTrack off-line browser | 31+4 | 6.94 MB | 29 Aug 2009 - 04:51 |
| BSpider | 10+25 | 36.75 KB | 29 Aug 2009 - 05:22 |
| lwp-request | 27 | 74.64 KB | 31 Aug 2009 - 19:06 |
| Checkbot | 27 | 7.96 KB | 31 Aug 2009 - 03:21 |
| Netcraft | 23 | 103.97 KB | 26 Aug 2009 - 19:23 |
| SpiderMan | 20+2 | 120.84 KB | 31 Aug 2009 - 13:52 |
| NewsGator Online | 18 | 0 | 29 Aug 2009 - 12:34 |
| Fish search | 18 | 1.72 MB | 31 Aug 2009 - 07:24 |
| W3C Validator | 17 | 91.95 KB | 27 Aug 2009 - 15:27 |
| Combine System | 13+2 | 1.11 MB | 14 Aug 2009 - 18:31 |
| BBot | 14 | 1.23 MB | 21 Aug 2009 - 14:05 |
| SurveyBot | 11 | 1.51 MB | 31 Aug 2009 - 18:33 |
| Voyager | 0+10 | 3.77 KB | 18 Aug 2009 - 06:58 |
| Motor | 9 | 4.47 MB | 31 Aug 2009 - 14:03 |
| Cursor | 8 | 886.34 KB | 24 Aug 2009 - 16:41 |
| WallPaper (alias crawlpaper) | 8 | 10.25 MB | 27 Aug 2009 - 10:11 |
| Scooter | 0+8 | 3.02 KB | 29 Aug 2009 - 15:42 |
| SuperBot | 5 | 67.32 KB | 22 Aug 2009 - 07:00 |
| YahooSeeker Yahoo! Blog crawler | 2+3 | 26.71 KB | 30 Aug 2009 - 23:50 |
| W3C jigsaw CSS Validator | 5 | 8.77 KB | 27 Aug 2009 - 15:27 |
| Holmes | 2+2 | 1.22 MB | 25 Aug 2009 - 14:17 |
| W3C Link Checker | 3+1 | 1.24 KB | 20 Aug 2009 - 11:27 |
| Girafabot | 0+3 | 1.13 KB | 24 Aug 2009 - 06:00 |
| Microsoft URL Control | 2 | 3.86 KB | 18 Aug 2009 - 01:47 |
| Susie | 2 | 5.70 KB | 29 Aug 2009 - 09:33 |
| Findlinks | 1+1 | 17.05 KB | 21 Aug 2009 - 07:42 |
| arianna.libero.it | 1+1 | 8.96 KB | 14 Aug 2009 - 16:45 |
| Internet Shinchakubin | 2 | 2.88 MB | 27 Aug 2009 - 12:18 |
| Feedburner | 2 | 686 Bytes | 23 Aug 2009 - 02:26 |
| Web Downloader | 2 | 41.24 KB | 28 Aug 2009 - 00:41 |
| HTMLParser | 2 | 1.56 MB | 25 Aug 2009 - 12:23 |
| mnoGoSearch search engine software | 2 | 3.74 KB | 02 Aug 2009 - 08:03 |
| MSRBOT | 1+1 | 137.15 KB | 19 Aug 2009 - 08:57 |
| Xenu Link Sleuth | 1 | 283 Bytes | 21 Aug 2009 - 19:34 |
| Seekbot | 1 | 5.72 KB | 16 Aug 2009 - 18:17 |
| Zeus Webster Pro | 1 | 860 Bytes | 16 Aug 2009 - 16:47 |
| JoBo Java Web Robot | 1 | 12.10 KB | 07 Aug 2009 - 18:18 |
| UCSD Crawl | 1 | 147.77 KB | 23 Aug 2009 - 15:53 |
| Y!J Yahoo Japan | 1 | 20.56 KB | 06 Aug 2009 - 06:35 |
| arks | 1 | 66.94 KB | 01 Aug 2009 - 07:47 |
| Biz360 spider | 1 | 98.25 KB | 11 Aug 2009 - 14:59 |