| 95 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 979747+281 | 19.16 GB | 31 Oct 2010 - 23:59 |
| Load Balancing Server | 601994 | 2.71 GB | 31 Oct 2010 - 23:59 |
| Yahoo Slurp | 80896+440 | 9.04 GB | 31 Oct 2010 - 23:57 |
| Yandex bot | 46443+223 | 1.56 GB | 31 Oct 2010 - 23:55 |
| Unknown robot (identified by 'crawl') | 20647+7923 | 161.23 MB | 31 Oct 2010 - 23:50 |
| Nagios | 26053 | 126.30 MB | 31 Oct 2010 - 23:52 |
| Unknown robot (identified by 'bot/' or 'bot-') | 15100+2559 | 909.03 MB | 31 Oct 2010 - 23:59 |
| MSNBot | 14117+1996 | 617.03 MB | 31 Oct 2010 - 23:25 |
| Ocelli | 12265+1 | 1.15 GB | 05 Oct 2010 - 17:10 |
| FAST Enterprise Crawler | 11915+61 | 551.56 MB | 31 Oct 2010 - 23:57 |
| Python-urllib | 10997+2 | 5.64 GB | 31 Oct 2010 - 23:26 |
| MSNBot-media | 6165+1529 | 1.28 GB | 31 Oct 2010 - 23:25 |
| WebVac | 5186+1 | 26.89 MB | 27 Oct 2010 - 14:45 |
| Exabot | 4746+48 | 38.80 MB | 31 Oct 2010 - 23:58 |
| Voila | 3445+121 | 170.32 MB | 31 Oct 2010 - 23:47 |
| Unknown robot (identified by 'spider') | 2243+1069 | 22.28 MB | 31 Oct 2010 - 23:51 |
| BaiDuSpider | 2804+321 | 799.17 MB | 31 Oct 2010 - 23:25 |
| Ask | 2360+112 | 160.90 MB | 31 Oct 2010 - 23:02 |
| Java (Often spam bot) | 1989+13 | 252.26 MB | 31 Oct 2010 - 23:43 |
| Nutch | 1543+176 | 31.52 MB | 31 Oct 2010 - 23:31 |
| Fish search | 1705 | 472.93 MB | 31 Oct 2010 - 18:34 |
| CFNetwork | 1694 | 1.51 GB | 31 Oct 2010 - 23:52 |
| Speedy Spider | 1148+504 | 11.54 MB | 31 Oct 2010 - 22:21 |
| HTTrack off-line browser | 1546+17 | 50.94 MB | 31 Oct 2010 - 23:33 |
| MLBot | 1377+106 | 28.04 MB | 31 Oct 2010 - 22:46 |
| UP.Browser | 1319 | 345.40 MB | 31 Oct 2010 - 23:34 |
| Unknown robot (identified by 'robot') | 942+93 | 8.33 MB | 31 Oct 2010 - 21:54 |
| DoCoMo | 852+77 | 10.65 MB | 31 Oct 2010 - 22:51 |
| Feedfetcher-Google | 737 | 90.64 MB | 31 Oct 2010 - 23:07 |
| BSpider | 641+65 | 4.96 MB | 31 Oct 2010 - 20:40 |
| Unknown robot (identified by hit on 'robots.txt') | 0+701 | 317.20 KB | 31 Oct 2010 - 23:49 |
| MJ12bot | 589+55 | 4.42 MB | 31 Oct 2010 - 23:02 |
| Powermarks | 493 | 609.67 KB | 31 Oct 2010 - 23:01 |
| Motor | 468 | 138.39 MB | 31 Oct 2010 - 23:55 |
| Custo | 263+90 | 33.28 MB | 31 Oct 2010 - 21:39 |
| Yahoo! Slurp China | 235+78 | 9.38 MB | 31 Oct 2010 - 23:01 |
| Web Core / Roots | 311 | 425.14 MB | 31 Oct 2010 - 23:43 |
| WordPress | 305 | 1.63 MB | 31 Oct 2010 - 21:33 |
| Turn It In | 255+4 | 6.66 MB | 25 Oct 2010 - 11:25 |
| Jakarta commons-httpclient | 237+1 | 35.67 MB | 31 Oct 2010 - 20:35 |
| Alexa (IA Archiver) | 156+60 | 5.15 MB | 31 Oct 2010 - 13:05 |
| psbot | 174+21 | 8.51 MB | 30 Oct 2010 - 05:50 |
| The web archive (IA Archiver) | 5+177 | 2.70 MB | 31 Oct 2010 - 17:09 |
| VSE | 165 | 7.39 MB | 31 Oct 2010 - 07:09 |
| TencentTraveler | 136 | 62.53 MB | 31 Oct 2010 - 23:11 |
| WebCollage | 108 | 10.74 MB | 30 Oct 2010 - 23:22 |
| Findlinks | 92+5 | 607.63 KB | 31 Oct 2010 - 15:20 |
| yacy | 43+40 | 4.52 MB | 31 Oct 2010 - 03:04 |
| W3C Validator | 82 | 671.15 KB | 31 Oct 2010 - 22:32 |
| MSIECrawler | 61+10 | 3.47 MB | 31 Oct 2010 - 15:21 |
| Heritrix | 55+8 | 2.15 MB | 30 Oct 2010 - 02:28 |
| GigaBot | 21+39 | 141.88 KB | 31 Oct 2010 - 14:01 |
| Netcraft | 60 | 175.01 KB | 31 Oct 2010 - 01:47 |
| legs | 19+39 | 7.92 MB | 30 Oct 2010 - 05:01 |
| Xenu Link Sleuth | 57 | 15.17 KB | 25 Oct 2010 - 17:46 |
| larbin | 30+25 | 224.38 KB | 30 Oct 2010 - 04:11 |
| SuperBot | 45 | 29.36 KB | 24 Oct 2010 - 07:17 |
| Google AdSense | 39 | 810.44 KB | 31 Oct 2010 - 21:58 |
| W3C jigsaw CSS Validator | 28 | 37.60 KB | 21 Oct 2010 - 15:25 |
| DNAbot | 17+10 | 164.87 KB | 28 Oct 2010 - 18:15 |
| InfoBot | 19 | 864.77 KB | 08 Oct 2010 - 05:50 |
| Microsoft URL Control | 17 | 2.82 MB | 28 Oct 2010 - 09:59 |
| SurveyBot | 13+3 | 75.88 KB | 30 Oct 2010 - 17:38 |
| WallPaper (alias crawlpaper) | 15 | 895.99 KB | 28 Oct 2010 - 07:49 |
| Voyager | 14 | 2.07 MB | 25 Oct 2010 - 23:09 |
| NG 1.x (Exalead) | 12 | 1.36 MB | 31 Oct 2010 - 10:52 |
| StackRambler | 0+9 | 3.39 KB | 25 Oct 2010 - 10:40 |
| EasyDL | 9 | 394.32 KB | 26 Oct 2010 - 12:00 |
| Vagabondo | 2+6 | 8.25 KB | 31 Oct 2010 - 09:46 |
| HKU WWW Octopus | 7 | 2.09 KB | 13 Oct 2010 - 14:24 |
| LinkChecker | 5+2 | 10.09 KB | 03 Oct 2010 - 21:16 |
| Crawl libcrawl | 3+3 | 11.91 KB | 09 Oct 2010 - 18:35 |
| archive.org bot | 4+2 | 267.95 KB | 27 Oct 2010 - 12:15 |
| arks | 5 | 343.72 KB | 11 Oct 2010 - 23:07 |
| W3C Link Checker | 2+2 | 1.33 KB | 26 Oct 2010 - 17:50 |
| JBot Java Web Robot | 3 | 47.62 KB | 03 Oct 2010 - 19:36 |
| SpiderMan | 1+2 | 175.72 KB | 10 Oct 2010 - 09:50 |
| BBot | 3 | 21.85 MB | 26 Oct 2010 - 01:31 |
| YahooSeeker Yahoo! Blog crawler | 1+2 | 204.29 KB | 21 Oct 2010 - 23:41 |
| Checkbot | 3 | 916 Bytes | 19 Oct 2010 - 04:43 |
| TITAN | 3 | 223.82 KB | 30 Oct 2010 - 23:28 |
| mnoGoSearch search engine software | 3 | 12.85 KB | 28 Oct 2010 - 03:25 |
| Digimarc MarcSpider | 2 | 107.22 KB | 03 Oct 2010 - 00:32 |
| Susie | 2 | 12.86 KB | 27 Oct 2010 - 17:01 |
| Shoutcast Directory Service | 2 | 65.97 KB | 04 Oct 2010 - 01:47 |
| arianna.libero.it | 1+1 | 49.68 KB | 27 Oct 2010 - 06:24 |
| NetMechanic | 1+1 | 652 Bytes | 30 Oct 2010 - 23:06 |
| Combine System | 1+1 | 386 Bytes | 22 Oct 2010 - 20:12 |
| Internet Shinchakubin | 1 | 1.56 KB | 20 Oct 2010 - 19:36 |
| Feedburner | 1 | 342 Bytes | 14 Oct 2010 - 23:09 |
| The World Wide Web Worm | 1 | 67.49 KB | 08 Oct 2010 - 13:25 |
| Wild Ferret Web Hopper #1, #2, #3 | 1 | 35.78 KB | 28 Oct 2010 - 13:40 |
| BlogSearch | 0+1 | 331 Bytes | 16 Oct 2010 - 02:38 |
| lwp-trivial | 0+1 | 386 Bytes | 04 Oct 2010 - 14:17 |
| Perman surfer | 0+1 | 386 Bytes | 26 Oct 2010 - 05:37 |