| 98 different robots | Hits | Bandwidth | Last visit |
|---|
| Load Balancing Server | 448364 | 5.46 GB | 31 Aug 2009 - 23:38 |
| MSNBot | 116559+2120 | 2.73 GB | 31 Aug 2009 - 23:38 |
| Googlebot | 101349+56 | 6.61 GB | 31 Aug 2009 - 23:35 |
| Yahoo Slurp | 53125+217 | 3.21 GB | 31 Aug 2009 - 23:34 |
| Nagios | 19097 | 45.62 MB | 31 Aug 2009 - 23:35 |
| Heritrix | 12645+1692 | 89.62 MB | 31 Aug 2009 - 20:09 |
| Yahoo-MMCrawler | 12541+8 | 4.42 GB | 31 Aug 2009 - 23:37 |
| FAST Enterprise Crawler | 7065+36 | 389.27 MB | 31 Aug 2009 - 22:19 |
| Unknown robot (identified by 'crawl') | 4554+1914 | 64.71 MB | 31 Aug 2009 - 23:37 |
| Unknown robot (identified by 'spider') | 4791+1126 | 33.56 MB | 31 Aug 2009 - 23:37 |
| Unknown robot (identified by hit on 'robots.txt') | 0+5463 | 2.01 MB | 31 Aug 2009 - 23:28 |
| Voila | 4951+39 | 85.85 MB | 31 Aug 2009 - 23:02 |
| Exabot | 4650+26 | 9.81 MB | 31 Aug 2009 - 23:35 |
| MLBot | 4613+47 | 21.93 MB | 31 Aug 2009 - 23:02 |
| Java (Often spam bot) | 4164+6 | 107.91 MB | 31 Aug 2009 - 20:42 |
| Unknown robot (identified by 'robot') | 3666+96 | 149.29 MB | 31 Aug 2009 - 23:26 |
| Ask | 3527+137 | 252.64 MB | 31 Aug 2009 - 23:22 |
| VSE | 2991 | 298.84 MB | 31 Aug 2009 - 17:08 |
| BaiDuSpider | 1770+86 | 47.92 MB | 31 Aug 2009 - 23:25 |
| psbot | 1734+106 | 10.96 MB | 31 Aug 2009 - 23:13 |
| GigaBot | 1138+215 | 8.63 MB | 31 Aug 2009 - 23:33 |
| Unknown robot (identified by 'bot/' or 'bot-') | 1121+125 | 31.80 MB | 31 Aug 2009 - 20:20 |
| Powermarks | 696 | 333.00 KB | 31 Aug 2009 - 23:20 |
| Python-urllib | 604+91 | 151.72 MB | 31 Aug 2009 - 17:35 |
| Custo | 526+132 | 27.80 MB | 31 Aug 2009 - 17:20 |
| CFNetwork | 591 | 248.05 MB | 31 Aug 2009 - 23:25 |
| Nutch | 415+142 | 34.89 MB | 31 Aug 2009 - 20:55 |
| Speedy Spider | 462+67 | 9.59 MB | 31 Aug 2009 - 21:36 |
| TencentTraveler | 484 | 33.25 MB | 31 Aug 2009 - 22:33 |
| The web archive (IA Archiver) | 0+469 | 176.79 KB | 31 Aug 2009 - 06:26 |
| Yahoo! Slurp China | 381+44 | 12.98 MB | 31 Aug 2009 - 01:44 |
| Alexa (IA Archiver) | 286+78 | 10.56 MB | 31 Aug 2009 - 19:33 |
| MJ12bot | 347+10 | 1.89 MB | 31 Aug 2009 - 14:39 |
| UP.Browser | 330 | 23.42 MB | 31 Aug 2009 - 21:14 |
| Yandex bot | 257+66 | 12.52 MB | 31 Aug 2009 - 07:48 |
| Jakarta commons-httpclient | 291+14 | 15.36 MB | 31 Aug 2009 - 19:54 |
| UniversalFeedParser | 277 | 0 | 31 Aug 2009 - 22:53 |
| WebVac | 247+1 | 4.07 MB | 08 Aug 2009 - 05:23 |
| Feedfetcher-Google | 242 | 1.05 MB | 31 Aug 2009 - 19:26 |
| InfoBot | 222+11 | 4.39 MB | 30 Aug 2009 - 10:19 |
| Ocelli | 218+2 | 1.98 MB | 19 Aug 2009 - 15:58 |
| lwp-trivial | 218 | 12.69 MB | 11 Aug 2009 - 17:01 |
| Turn It In | 193+1 | 1.53 MB | 17 Aug 2009 - 00:55 |
| WebCollage | 152 | 14.07 MB | 31 Aug 2009 - 15:17 |
| Lycos | 127+24 | 23.51 MB | 31 Aug 2009 - 14:56 |
| WordPress | 126 | 3.01 MB | 28 Aug 2009 - 10:40 |
| larbin | 57+63 | 4.08 MB | 30 Aug 2009 - 00:07 |
| legs | 28+56 | 12.69 MB | 31 Aug 2009 - 19:31 |
| Web Core / Roots | 57 | 63.24 MB | 31 Aug 2009 - 04:16 |
| yacy | 25+30 | 9.86 MB | 31 Aug 2009 - 08:56 |
| Google AdSense | 52 | 577.93 KB | 29 Aug 2009 - 23:21 |
| Gaisbot | 39+12 | 1.98 MB | 28 Aug 2009 - 15:34 |
| BlogSearch | 48 | 1.67 MB | 31 Aug 2009 - 13:25 |
| DoCoMo | 42+2 | 1.39 MB | 30 Aug 2009 - 07:20 |
| Xenu Link Sleuth | 44 | 12.22 KB | 30 Aug 2009 - 22:24 |
| LinkWalker | 23+19 | 146.15 KB | 31 Aug 2009 - 23:23 |
| MSIECrawler | 27+12 | 524.47 KB | 31 Aug 2009 - 05:06 |
| Grub.org | 37 | 22.50 KB | 31 Aug 2009 - 19:11 |
| HTTrack off-line browser | 31+4 | 6.94 MB | 29 Aug 2009 - 04:51 |
| BSpider | 10+25 | 36.75 KB | 29 Aug 2009 - 05:22 |
| lwp-request | 27 | 74.64 KB | 31 Aug 2009 - 19:06 |
| Checkbot | 27 | 7.96 KB | 31 Aug 2009 - 03:21 |
| SpiderMan | 19+2 | 79.66 KB | 31 Aug 2009 - 13:52 |
| NewsGator Online | 19 | 0 | 29 Aug 2009 - 12:34 |
| W3C Validator | 17 | 91.95 KB | 27 Aug 2009 - 15:27 |
| Fish search | 17 | 1.04 MB | 31 Aug 2009 - 07:24 |
| Voyager | 0+10 | 3.77 KB | 18 Aug 2009 - 06:58 |
| Motor | 8 | 598.05 KB | 31 Aug 2009 - 14:03 |
| BBot | 8 | 675.74 KB | 21 Aug 2009 - 14:05 |
| Combine System | 6+2 | 170.53 KB | 14 Aug 2009 - 18:18 |
| Scooter | 0+8 | 3.02 KB | 29 Aug 2009 - 15:42 |
| SurveyBot | 6 | 17.37 KB | 29 Aug 2009 - 01:04 |
| Cursor | 6 | 349.88 KB | 24 Aug 2009 - 16:41 |
| Netcraft | 6 | 25.68 KB | 26 Aug 2009 - 19:23 |
| WallPaper (alias crawlpaper) | 6 | 100.66 KB | 27 Aug 2009 - 10:11 |
| MojeekBot | 4+2 | 40.61 KB | 24 Aug 2009 - 21:13 |
| YahooSeeker Yahoo! Blog crawler | 2+3 | 26.71 KB | 30 Aug 2009 - 23:50 |
| W3C jigsaw CSS Validator | 5 | 8.77 KB | 27 Aug 2009 - 15:27 |
| Holmes | 2+2 | 1.22 MB | 25 Aug 2009 - 14:17 |
| Girafabot | 0+3 | 1.13 KB | 24 Aug 2009 - 06:00 |
| Microsoft URL Control | 2 | 3.86 KB | 18 Aug 2009 - 01:47 |
| SuperBot | 2 | 4.69 KB | 22 Aug 2009 - 07:00 |
| Findlinks | 1+1 | 17.05 KB | 21 Aug 2009 - 07:42 |
| arianna.libero.it | 1+1 | 8.96 KB | 14 Aug 2009 - 16:45 |
| Feedburner | 2 | 686 Bytes | 23 Aug 2009 - 02:26 |
| HTMLParser | 2 | 1.56 MB | 25 Aug 2009 - 12:23 |
| W3C Link Checker | 1+1 | 708 Bytes | 20 Aug 2009 - 11:27 |
| MSRBOT | 1+1 | 137.15 KB | 19 Aug 2009 - 08:57 |
| Xenu Link Sleuth | 1 | 283 Bytes | 21 Aug 2009 - 19:34 |
| Susie | 1 | 3.57 KB | 01 Aug 2009 - 06:52 |
| Internet Shinchakubin | 1 | 106.34 KB | 27 Aug 2009 - 12:18 |
| JoBo Java Web Robot | 1 | 12.10 KB | 07 Aug 2009 - 18:18 |
| Web Downloader | 1 | 0 | 06 Aug 2009 - 07:09 |
| UCSD Crawl | 1 | 147.77 KB | 23 Aug 2009 - 15:53 |
| mnoGoSearch search engine software | 1 | 2.93 KB | 01 Aug 2009 - 08:52 |
| Y!J Yahoo Japan | 1 | 20.56 KB | 06 Aug 2009 - 06:35 |
| arks | 1 | 66.94 KB | 01 Aug 2009 - 07:47 |
| Biz360 spider | 1 | 98.25 KB | 11 Aug 2009 - 14:59 |