| 83 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 74114+41 | 5.83 GB | 31 Jul 2012 - 23:59 |
| Load Balancing Server | 68087 | 203.69 MB | 31 Jul 2012 - 23:59 |
| Unknown robot (identified by 'crawl') | 17710+5924 | 88.17 MB | 31 Jul 2012 - 23:51 |
| Yandex bot | 21424+51 | 867.47 MB | 31 Jul 2012 - 22:39 |
| Unknown robot (identified by 'bot/' or 'bot-') | 18583+261 | 1.37 GB | 31 Jul 2012 - 23:59 |
| Nagios | 14614 | 22.35 MB | 31 Jul 2012 - 23:55 |
| FAST Enterprise Crawler | 10781+24 | 99.76 MB | 28 Jul 2012 - 00:26 |
| BaiDuSpider | 7289+41 | 146.85 MB | 31 Jul 2012 - 23:59 |
| WebVac | 6117+1 | 35.63 MB | 12 Jul 2012 - 13:41 |
| MSNBot-media | 2934+1196 | 247.27 MB | 31 Jul 2012 - 22:52 |
| CFNetwork | 3682 | 613.34 MB | 31 Jul 2012 - 23:42 |
| Exabot | 3389+22 | 18.31 MB | 31 Jul 2012 - 23:56 |
| Feedfetcher-Google | 2936 | 45.28 MB | 31 Jul 2012 - 23:50 |
| Unknown robot (identified by 'robot') | 1703+33 | 45.60 MB | 31 Jul 2012 - 10:34 |
| Yahoo Slurp | 1547+69 | 42.47 MB | 31 Jul 2012 - 22:54 |
| Nutch | 1426+106 | 35.59 MB | 31 Jul 2012 - 15:26 |
| MJ12bot | 1247+143 | 17.23 MB | 31 Jul 2012 - 18:47 |
| UniversalFeedParser | 1297 | 85.04 KB | 31 Jul 2012 - 23:40 |
| Heritrix | 1270+10 | 1022.83 MB | 13 Jul 2012 - 09:28 |
| TencentTraveler | 1199 | 455.04 MB | 31 Jul 2012 - 18:26 |
| Java (Often spam bot) | 917+7 | 116.97 MB | 31 Jul 2012 - 16:16 |
| VORTEX | 915 | 1.86 MB | 31 Jul 2012 - 21:23 |
| Motor | 876 | 4.90 MB | 31 Jul 2012 - 16:19 |
| Voila | 707+50 | 40.98 MB | 31 Jul 2012 - 22:43 |
| WordPress | 720 | 8.14 MB | 31 Jul 2012 - 23:50 |
| Unknown robot (identified by hit on 'robots.txt') | 0+693 | 284.88 KB | 31 Jul 2012 - 23:27 |
| Unknown robot (identified by 'spider') | 495+108 | 66.03 MB | 31 Jul 2012 - 22:07 |
| Python-urllib | 348+80 | 65.74 MB | 31 Jul 2012 - 23:18 |
| Vagabondo | 339+7 | 269.14 KB | 25 Jul 2012 - 04:35 |
| psbot | 235+34 | 9.15 MB | 31 Jul 2012 - 23:35 |
| Alexa (IA Archiver) | 137+97 | 8.34 MB | 31 Jul 2012 - 22:42 |
| HTTrack off-line browser | 210+2 | 15.33 MB | 31 Jul 2012 - 07:10 |
| MagpieRSS | 188+20 | 8.28 KB | 31 Jul 2012 - 10:48 |
| UP.Browser | 205 | 27.06 MB | 31 Jul 2012 - 23:42 |
| BSpider | 185+11 | 1.11 MB | 31 Jul 2012 - 19:20 |
| MSNBot | 170+21 | 4.81 MB | 31 Jul 2012 - 15:42 |
| MLBot | 121+52 | 1.68 MB | 31 Jul 2012 - 16:58 |
| WebFilter | 165 | 1.56 MB | 31 Jul 2012 - 21:18 |
| Web Core / Roots | 133 | 140.67 MB | 31 Jul 2012 - 22:12 |
| DoCoMo | 89+40 | 9.93 MB | 31 Jul 2012 - 02:47 |
| NG 1.x (Exalead) | 129 | 2.60 MB | 31 Jul 2012 - 22:08 |
| legs | 96+30 | 17.50 MB | 31 Jul 2012 - 11:53 |
| WallPaper (alias crawlpaper) | 99 | 12.72 MB | 31 Jul 2012 - 18:08 |
| Xenu Link Sleuth | 95 | 87.90 KB | 31 Jul 2012 - 16:05 |
| Powermarks | 94 | 1.31 MB | 31 Jul 2012 - 17:28 |
| archive.org bot | 25+16 | 3.14 MB | 30 Jul 2012 - 10:43 |
| Jakarta commons-httpclient | 36 | 9.90 MB | 30 Jul 2012 - 11:36 |
| ichiro | 22+8 | 905.77 KB | 20 Jul 2012 - 20:26 |
| Phantom | 27 | 6.66 MB | 31 Jul 2012 - 14:25 |
| SeznamBot | 14+11 | 1.07 MB | 24 Jul 2012 - 04:26 |
| SpiderMan | 21+4 | 93.49 KB | 25 Jul 2012 - 18:56 |
| Yahoo! Slurp China | 19 | 91.73 KB | 26 Jul 2012 - 21:01 |
| yacy | 14+4 | 61.25 KB | 31 Jul 2012 - 06:44 |
| Emacs-w3 Search Engine | 18 | 176.88 KB | 17 Jul 2012 - 01:26 |
| Turn It In | 7+10 | 77.25 KB | 24 Jul 2012 - 07:15 |
| Findlinks | 8+9 | 28.79 KB | 29 Jul 2012 - 10:53 |
| WebCollage | 15 | 1.23 MB | 31 Jul 2012 - 08:41 |
| bender focused_crawler | 11+3 | 196.70 KB | 30 Jul 2012 - 23:24 |
| Netcraft | 14 | 53.56 KB | 13 Jul 2012 - 15:00 |
| Y!J Yahoo Japan | 6+5 | 217.71 KB | 26 Jul 2012 - 21:53 |
| Google AdSense | 10 | 389.30 KB | 28 Jul 2012 - 07:24 |
| W3C Link Checker | 8+1 | 6.54 KB | 27 Jul 2012 - 10:42 |
| LinkBot | 6 | 18.58 KB | 31 Jul 2012 - 00:08 |
| W3C jigsaw CSS Validator | 6 | 63.84 KB | 13 Jul 2012 - 14:00 |
| fido | 6 | 64.18 KB | 31 Jul 2012 - 12:46 |
| NewsGator Online | 5 | 141.72 KB | 29 Jul 2012 - 13:06 |
| SurveyBot | 4 | 28.42 KB | 19 Jul 2012 - 21:54 |
| VSE | 4 | 264.96 KB | 27 Jul 2012 - 12:40 |
| StackRambler | 3 | 287.22 KB | 26 Jul 2012 - 08:17 |
| larbin | 2+1 | 3.75 KB | 29 Jul 2012 - 08:16 |
| Netluchs | 1+1 | 5.83 KB | 12 Jul 2012 - 00:07 |
| W3C Validator | 2 | 21.24 KB | 13 Jul 2012 - 14:00 |
| Sven | 1+1 | 37.54 KB | 05 Jul 2012 - 14:52 |
| NG 2.x (Exalead) | 2 | 64.32 KB | 29 Jul 2012 - 05:45 |
| Sunrise | 2 | 3.74 KB | 09 Jul 2012 - 23:05 |
| FeedValidator | 2 | 21.24 KB | 13 Jul 2012 - 14:00 |
| MSIECrawler | 2 | 714.63 KB | 16 Jul 2012 - 11:49 |
| NimbleCrawler | 1 | 88.89 KB | 14 Jul 2012 - 20:17 |
| ActiveBookmark | 1 | 305 Bytes | 25 Jul 2012 - 12:29 |
| BBot | 1 | 3.04 KB | 07 Jul 2012 - 06:06 |
| TITAN | 1 | 174.77 KB | 08 Jul 2012 - 04:07 |
| Scooter | 1 | 2.57 KB | 13 Jul 2012 - 12:54 |
| arks | 1 | 700 Bytes | 25 Jul 2012 - 23:23 |