| 83 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 499564+63 | 11.27 GB | 30 Apr 2011 - 23:59 |
| Load Balancing Server | 74594 | 931.72 MB | 30 Apr 2011 - 23:59 |
| Yahoo Slurp | 63653+171 | 7.18 GB | 30 Apr 2011 - 23:59 |
| Yandex bot | 48000+86 | 2.22 GB | 30 Apr 2011 - 23:59 |
| Unknown robot (identified by 'bot/' or 'bot-') | 43515+1796 | 1.21 GB | 30 Apr 2011 - 23:59 |
| Unknown robot (identified by 'crawl') | 9945+5184 | 95.37 MB | 30 Apr 2011 - 23:36 |
| FAST Enterprise Crawler | 6475+13 | 53.19 MB | 30 Apr 2011 - 23:58 |
| Unknown robot (identified by 'robot') | 5688+59 | 68.27 MB | 30 Apr 2011 - 17:49 |
| WebVac | 5615+1 | 29.19 MB | 08 Apr 2011 - 00:35 |
| MSNBot-media | 4134+1117 | 939.79 MB | 30 Apr 2011 - 23:58 |
| Unknown robot (identified by 'spider') | 4090+132 | 80.67 MB | 30 Apr 2011 - 23:51 |
| Java (Often spam bot) | 3769 | 474.69 MB | 30 Apr 2011 - 20:32 |
| MJ12bot | 2468+157 | 41.78 MB | 30 Apr 2011 - 17:41 |
| Voila | 2006+63 | 113.50 MB | 30 Apr 2011 - 23:23 |
| Exabot | 2041+18 | 18.55 MB | 30 Apr 2011 - 23:55 |
| Speedy Spider | 1803+196 | 30.92 MB | 30 Apr 2011 - 22:40 |
| Motor | 1805 | 173.28 MB | 30 Apr 2011 - 23:29 |
| CFNetwork | 1302 | 302.45 MB | 30 Apr 2011 - 21:50 |
| Fish search | 1258 | 22.69 MB | 30 Apr 2011 - 23:47 |
| Feedfetcher-Google | 1255 | 100.15 MB | 30 Apr 2011 - 23:31 |
| BaiDuSpider | 1127+92 | 60.21 MB | 30 Apr 2011 - 21:38 |
| Nutch | 1051+62 | 42.93 MB | 30 Apr 2011 - 23:05 |
| UP.Browser | 982 | 288.18 MB | 30 Apr 2011 - 22:17 |
| WordPress | 958 | 10.92 MB | 30 Apr 2011 - 23:15 |
| Heritrix | 933+7 | 175.75 MB | 22 Apr 2011 - 00:13 |
| Unknown robot (identified by hit on 'robots.txt') | 0+744 | 312.65 KB | 30 Apr 2011 - 23:00 |
| Python-urllib | 470+127 | 260.08 MB | 30 Apr 2011 - 17:16 |
| MLBot | 422+37 | 5.95 MB | 30 Apr 2011 - 18:33 |
| Powermarks | 406 | 319.26 KB | 29 Apr 2011 - 16:10 |
| Web Core / Roots | 337 | 276.06 MB | 30 Apr 2011 - 20:21 |
| bender focused_crawler | 301+30 | 19.47 MB | 30 Apr 2011 - 23:17 |
| MSNBot | 278+41 | 3.53 MB | 30 Apr 2011 - 04:13 |
| Custo | 277+41 | 16.72 MB | 30 Apr 2011 - 21:14 |
| HTMLParser | 315 | 16.42 MB | 30 Apr 2011 - 05:05 |
| GigaBot | 191+112 | 574.33 KB | 30 Apr 2011 - 15:35 |
| Alexa (IA Archiver) | 158+104 | 9.87 MB | 30 Apr 2011 - 10:57 |
| The web archive (IA Archiver) | 1+258 | 106.80 KB | 30 Apr 2011 - 20:20 |
| Yahoo! Slurp China | 225+25 | 8.61 MB | 30 Apr 2011 - 23:14 |
| Jakarta commons-httpclient | 234 | 37.82 MB | 30 Apr 2011 - 22:55 |
| legs | 146+82 | 8.81 MB | 30 Apr 2011 - 15:13 |
| BSpider | 218+5 | 1.38 MB | 30 Apr 2011 - 22:34 |
| ichiro | 170+35 | 9.03 MB | 30 Apr 2011 - 21:13 |
| WallPaper (alias crawlpaper) | 187 | 37.08 MB | 30 Apr 2011 - 23:59 |
| DoCoMo | 95+36 | 4.11 MB | 30 Apr 2011 - 16:36 |
| TencentTraveler | 128 | 6.11 MB | 30 Apr 2011 - 23:55 |
| VORTEX | 98 | 7.55 MB | 30 Apr 2011 - 23:55 |
| MagpieRSS | 68+19 | 7.87 KB | 30 Apr 2011 - 15:43 |
| VSE | 73 | 31.06 MB | 29 Apr 2011 - 09:37 |
| larbin | 40+31 | 391.17 KB | 30 Apr 2011 - 11:19 |
| HTTrack off-line browser | 67+1 | 7.70 MB | 30 Apr 2011 - 23:32 |
| archive.org bot | 54+7 | 6.56 MB | 19 Apr 2011 - 23:45 |
| psbot | 41+12 | 7.01 MB | 25 Apr 2011 - 13:04 |
| WebCollage | 51 | 2.68 MB | 29 Apr 2011 - 13:50 |
| Google AdSense | 32 | 949.87 KB | 26 Apr 2011 - 22:32 |
| Ask | 25+1 | 1.86 MB | 23 Apr 2011 - 00:49 |
| MSIECrawler | 15+8 | 495.03 KB | 29 Apr 2011 - 09:03 |
| Findlinks | 11+10 | 141.50 KB | 30 Apr 2011 - 22:29 |
| Voyager | 20 | 905.93 KB | 29 Apr 2011 - 16:55 |
| Xenu Link Sleuth | 18 | 17.78 KB | 29 Apr 2011 - 04:47 |
| EasyDL | 13 | 1.38 MB | 30 Apr 2011 - 06:51 |
| Steeler | 10+1 | 84.57 KB | 11 Apr 2011 - 10:16 |
| gammaSpider, FocusedCrawler | 10 | 1.01 MB | 09 Apr 2011 - 04:19 |
| SurveyBot | 9 | 41.07 KB | 26 Apr 2011 - 21:02 |
| Digger | 8 | 80.48 KB | 25 Apr 2011 - 18:37 |
| Netcraft | 8 | 39.63 KB | 28 Apr 2011 - 15:52 |
| LinkChecker | 5+3 | 170.76 KB | 20 Apr 2011 - 13:48 |
| Y!J Yahoo Japan | 6+2 | 4.12 KB | 26 Apr 2011 - 21:19 |
| yacy | 3+4 | 1.57 MB | 16 Apr 2011 - 13:09 |
| NetMechanic | 3+4 | 2.27 KB | 25 Apr 2011 - 02:14 |
| NG 1.x (Exalead) | 7 | 131.67 KB | 26 Apr 2011 - 20:39 |
| Microsoft URL Control | 6 | 227.48 KB | 27 Apr 2011 - 07:09 |
| arks | 3 | 911 Bytes | 15 Apr 2011 - 15:40 |
| W3C Validator | 2 | 14.96 KB | 25 Apr 2011 - 15:15 |
| Z-Add Link Checker | 1 | 302 Bytes | 10 Apr 2011 - 04:21 |
| FavOrg | 1 | 14.59 KB | 04 Apr 2011 - 21:20 |
| Grub.org | 1 | 2.57 KB | 13 Apr 2011 - 12:38 |
| StackRambler | 0+1 | 386 Bytes | 27 Apr 2011 - 10:29 |
| Digital Integrity Robot | 1 | 2.85 KB | 19 Apr 2011 - 08:00 |
| Muncher | 1 | 22.02 KB | 16 Apr 2011 - 15:55 |
| Vagabondo | 0+1 | 386 Bytes | 28 Apr 2011 - 09:51 |
| NutchCVS | 0+1 | 386 Bytes | 06 Apr 2011 - 14:10 |
| mnoGoSearch search engine software | 1 | 934 Bytes | 26 Apr 2011 - 11:35 |
| Link Valet Online | 1 | 303 Bytes | 20 Apr 2011 - 16:21 |