| 84 different robots | Hits | Bandwidth | Last visit |
|---|
| Load Balancing Server | 428403 | 834.57 MB | 31 Jul 2012 - 23:59 |
| Googlebot | 126442+251 | 6.34 GB | 31 Jul 2012 - 23:59 |
| Unknown robot (identified by 'crawl') | 24942+9424 | 104.02 MB | 31 Jul 2012 - 23:51 |
| Yandex bot | 22051+255 | 870.94 MB | 31 Jul 2012 - 22:39 |
| Nagios | 21631 | 63.82 MB | 31 Jul 2012 - 23:55 |
| Unknown robot (identified by 'bot/' or 'bot-') | 20376+705 | 1.44 GB | 31 Jul 2012 - 23:59 |
| BaiDuSpider | 15696+228 | 248.45 MB | 31 Jul 2012 - 23:59 |
| FAST Enterprise Crawler | 10818+26 | 100.05 MB | 28 Jul 2012 - 00:26 |
| WebVac | 6117+1 | 35.63 MB | 12 Jul 2012 - 13:41 |
| MSNBot-media | 2963+1210 | 248.78 MB | 31 Jul 2012 - 22:52 |
| CFNetwork | 3712 | 893.48 MB | 31 Jul 2012 - 23:42 |
| Exabot | 3444+43 | 18.57 MB | 31 Jul 2012 - 23:56 |
| Feedfetcher-Google | 2988 | 46.30 MB | 31 Jul 2012 - 23:50 |
| Yahoo Slurp | 1813+129 | 58.26 MB | 31 Jul 2012 - 22:54 |
| Unknown robot (identified by 'robot') | 1748+63 | 45.99 MB | 31 Jul 2012 - 19:50 |
| Nutch | 1626+144 | 42.99 MB | 31 Jul 2012 - 15:26 |
| MJ12bot | 1377+242 | 21.12 MB | 31 Jul 2012 - 18:47 |
| Python-urllib | 1348+138 | 526.57 MB | 31 Jul 2012 - 23:18 |
| Heritrix | 1318+13 | 1022.99 MB | 17 Jul 2012 - 07:29 |
| UniversalFeedParser | 1297 | 85.04 KB | 31 Jul 2012 - 23:40 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1257 | 519.34 KB | 31 Jul 2012 - 23:27 |
| TencentTraveler | 1211 | 462.22 MB | 31 Jul 2012 - 18:26 |
| Unknown robot (identified by 'spider') | 969+144 | 126.69 MB | 31 Jul 2012 - 22:07 |
| MSNBot | 966+42 | 6.79 MB | 31 Jul 2012 - 15:42 |
| Java (Often spam bot) | 959+9 | 117.26 MB | 31 Jul 2012 - 16:16 |
| VORTEX | 915 | 1.86 MB | 31 Jul 2012 - 21:23 |
| Motor | 876 | 4.90 MB | 31 Jul 2012 - 16:19 |
| Voila | 719+58 | 41.01 MB | 31 Jul 2012 - 22:43 |
| WordPress | 727 | 9.31 MB | 31 Jul 2012 - 23:50 |
| MagpieRSS | 549+34 | 728.90 KB | 31 Jul 2012 - 20:53 |
| MLBot | 303+178 | 4.22 MB | 31 Jul 2012 - 16:58 |
| Vagabondo | 339+7 | 269.14 KB | 25 Jul 2012 - 04:35 |
| psbot | 247+44 | 9.89 MB | 31 Jul 2012 - 23:35 |
| BSpider | 249+33 | 1.24 MB | 31 Jul 2012 - 22:05 |
| Alexa (IA Archiver) | 158+116 | 8.46 MB | 31 Jul 2012 - 22:42 |
| HTTrack off-line browser | 212+2 | 17.88 MB | 31 Jul 2012 - 07:10 |
| UP.Browser | 205 | 27.06 MB | 31 Jul 2012 - 23:42 |
| DoCoMo | 103+66 | 10.42 MB | 31 Jul 2012 - 19:05 |
| WebFilter | 165 | 1.56 MB | 31 Jul 2012 - 21:18 |
| legs | 105+49 | 17.75 MB | 31 Jul 2012 - 12:01 |
| Web Core / Roots | 135 | 143.11 MB | 31 Jul 2012 - 22:12 |
| NG 1.x (Exalead) | 129 | 2.60 MB | 31 Jul 2012 - 22:08 |
| Powermarks | 102 | 2.77 MB | 31 Jul 2012 - 17:28 |
| Xenu Link Sleuth | 101 | 89.54 KB | 31 Jul 2012 - 21:59 |
| WallPaper (alias crawlpaper) | 99 | 12.72 MB | 31 Jul 2012 - 18:08 |
| archive.org bot | 25+39 | 3.14 MB | 30 Jul 2012 - 10:43 |
| Phantom | 41 | 6.73 MB | 31 Jul 2012 - 14:25 |
| Netcraft | 40 | 119.62 KB | 13 Jul 2012 - 15:00 |
| ichiro | 22+14 | 907.82 KB | 24 Jul 2012 - 08:47 |
| Jakarta commons-httpclient | 36 | 9.90 MB | 30 Jul 2012 - 11:36 |
| SpiderMan | 22+6 | 95.01 KB | 25 Jul 2012 - 18:56 |
| SeznamBot | 15+12 | 1.75 MB | 24 Jul 2012 - 04:26 |
| Findlinks | 13+12 | 41.99 KB | 29 Jul 2012 - 10:53 |
| Yahoo! Slurp China | 23 | 99.67 KB | 28 Jul 2012 - 09:56 |
| yacy | 14+6 | 62.01 KB | 31 Jul 2012 - 06:44 |
| Turn It In | 7+12 | 77.93 KB | 24 Jul 2012 - 07:15 |
| WebCollage | 18 | 1.26 MB | 31 Jul 2012 - 08:41 |
| Emacs-w3 Search Engine | 18 | 176.88 KB | 17 Jul 2012 - 01:26 |
| Y!J Yahoo Japan | 7+8 | 220.36 KB | 26 Jul 2012 - 21:53 |
| bender focused_crawler | 11+3 | 196.70 KB | 30 Jul 2012 - 23:24 |
| Google AdSense | 10 | 389.30 KB | 28 Jul 2012 - 07:24 |
| W3C Link Checker | 8+1 | 6.54 KB | 27 Jul 2012 - 10:42 |
| SurveyBot | 7+1 | 32.39 KB | 28 Jul 2012 - 15:08 |
| larbin | 3+4 | 9.06 KB | 29 Jul 2012 - 08:16 |
| LinkBot | 6 | 18.58 KB | 31 Jul 2012 - 00:08 |
| W3C jigsaw CSS Validator | 6 | 63.84 KB | 13 Jul 2012 - 14:00 |
| fido | 6 | 64.18 KB | 31 Jul 2012 - 12:46 |
| NewsGator Online | 5 | 141.72 KB | 29 Jul 2012 - 13:06 |
| VSE | 4 | 264.96 KB | 27 Jul 2012 - 12:40 |
| StackRambler | 3 | 287.22 KB | 26 Jul 2012 - 08:17 |
| Netluchs | 1+1 | 5.83 KB | 12 Jul 2012 - 00:07 |
| W3C Validator | 2 | 21.24 KB | 13 Jul 2012 - 14:00 |
| Sven | 1+1 | 37.54 KB | 05 Jul 2012 - 14:52 |
| NG 2.x (Exalead) | 2 | 64.32 KB | 29 Jul 2012 - 05:45 |
| Sunrise | 2 | 3.74 KB | 09 Jul 2012 - 23:05 |
| FeedValidator | 2 | 21.24 KB | 13 Jul 2012 - 14:00 |
| MSIECrawler | 2 | 714.63 KB | 16 Jul 2012 - 11:49 |
| Microsoft URL Control | 1 | 7.40 KB | 06 Jul 2012 - 10:14 |
| NimbleCrawler | 1 | 88.89 KB | 14 Jul 2012 - 20:17 |
| ActiveBookmark | 1 | 305 Bytes | 25 Jul 2012 - 12:29 |
| BBot | 1 | 3.04 KB | 07 Jul 2012 - 06:06 |
| TITAN | 1 | 174.77 KB | 08 Jul 2012 - 04:07 |
| Scooter | 1 | 2.57 KB | 13 Jul 2012 - 12:54 |
| arks | 1 | 700 Bytes | 25 Jul 2012 - 23:23 |