| 102 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 612605+49 | 113.86 GB | 30 Nov 2009 - 23:59 |
| Load Balancing Server | 592190 | 4.30 GB | 30 Nov 2009 - 23:59 |
| MSNBot | 588941+682 | 9.73 GB | 30 Nov 2009 - 23:59 |
| Unknown robot (identified by 'robot') | 150406+104 | 3.99 GB | 30 Nov 2009 - 23:59 |
| Yahoo Slurp | 131618+189 | 31.54 GB | 30 Nov 2009 - 23:59 |
| MLBot | 114282+46 | 1.17 GB | 30 Nov 2009 - 23:47 |
| Unknown robot (identified by 'crawl') | 51055+2979 | 2.69 GB | 30 Nov 2009 - 23:41 |
| Unknown robot (identified by 'bot/' or 'bot-') | 38730+323 | 1.36 GB | 30 Nov 2009 - 23:45 |
| FAST Enterprise Crawler | 30594+14 | 964.50 MB | 17 Nov 2009 - 00:31 |
| Nagios | 24826 | 129.76 MB | 30 Nov 2009 - 23:49 |
| Java (Often spam bot) | 19679+5 | 3.53 GB | 30 Nov 2009 - 23:17 |
| Unknown robot (identified by 'spider') | 6250+990 | 36.52 MB | 30 Nov 2009 - 23:04 |
| Exabot | 5331+27 | 42.68 MB | 30 Nov 2009 - 23:57 |
| Voila | 4874+58 | 94.63 MB | 30 Nov 2009 - 23:53 |
| Yandex bot | 4608+132 | 62.11 MB | 30 Nov 2009 - 23:55 |
| Unknown robot (identified by hit on 'robots.txt') | 0+4462 | 1.68 MB | 30 Nov 2009 - 23:46 |
| BaiDuSpider | 3405+112 | 80.57 MB | 30 Nov 2009 - 23:29 |
| HTTrack off-line browser | 3178+7 | 573.09 MB | 30 Nov 2009 - 19:40 |
| Ask | 2933+147 | 247.16 MB | 30 Nov 2009 - 23:57 |
| MJ12bot | 1903+10 | 58.07 MB | 27 Nov 2009 - 10:01 |
| Heritrix | 1577+22 | 2.12 GB | 30 Nov 2009 - 23:03 |
| Speedy Spider | 1306+215 | 8.32 MB | 30 Nov 2009 - 13:27 |
| UP.Browser | 1415 | 408.23 MB | 30 Nov 2009 - 23:38 |
| Python-urllib | 1208+4 | 309.44 MB | 30 Nov 2009 - 21:54 |
| GigaBot | 972+185 | 4.64 MB | 23 Nov 2009 - 08:21 |
| CFNetwork | 827 | 7.94 GB | 30 Nov 2009 - 23:14 |
| DoCoMo | 694+32 | 199.39 MB | 30 Nov 2009 - 19:00 |
| Nutch | 575+70 | 12.73 MB | 30 Nov 2009 - 21:08 |
| Alexa (IA Archiver) | 568+49 | 19.49 MB | 30 Nov 2009 - 19:14 |
| Powermarks | 553 | 1.51 MB | 30 Nov 2009 - 23:31 |
| Custo | 367+138 | 738.90 MB | 30 Nov 2009 - 22:27 |
| Jakarta commons-httpclient | 438+9 | 78.58 MB | 30 Nov 2009 - 19:49 |
| Turn It In | 431+2 | 6.60 MB | 24 Nov 2009 - 09:07 |
| LiveJournal.com | 425 | 16.48 MB | 30 Nov 2009 - 23:37 |
| WordPress | 317 | 5.59 MB | 30 Nov 2009 - 23:40 |
| Yahoo! Slurp China | 239+64 | 7.35 MB | 30 Nov 2009 - 16:30 |
| The web archive (IA Archiver) | 0+259 | 97.63 KB | 30 Nov 2009 - 18:49 |
| TencentTraveler | 233 | 27.42 MB | 30 Nov 2009 - 15:13 |
| psbot | 198+16 | 232.45 MB | 25 Nov 2009 - 14:01 |
| yacy | 141+46 | 2.35 MB | 30 Nov 2009 - 10:38 |
| VSE | 147 | 34.45 MB | 30 Nov 2009 - 11:02 |
| Web Core / Roots | 143 | 238.10 MB | 30 Nov 2009 - 22:17 |
| WebVac | 127+1 | 2.09 MB | 04 Nov 2009 - 21:09 |
| Google AdSense | 101 | 3.24 MB | 30 Nov 2009 - 23:51 |
| Feedfetcher-Google | 100 | 11.09 MB | 30 Nov 2009 - 18:32 |
| WebCollage | 92 | 8.83 MB | 29 Nov 2009 - 20:03 |
| MSIECrawler | 60+24 | 5.19 MB | 29 Nov 2009 - 18:51 |
| legs | 26+35 | 708.39 KB | 30 Nov 2009 - 10:50 |
| InfoBot | 52+3 | 256.86 KB | 19 Nov 2009 - 20:18 |
| larbin | 28+23 | 381.46 KB | 30 Nov 2009 - 18:03 |
| Fish search | 43 | 40.06 MB | 30 Nov 2009 - 16:53 |
| LinkWalker | 20+18 | 113.56 KB | 29 Nov 2009 - 06:16 |
| Motor | 32+1 | 2.26 MB | 27 Nov 2009 - 10:32 |
| Xenu Link Sleuth | 33 | 9.20 KB | 29 Nov 2009 - 11:05 |
| Steeler | 31+1 | 378.02 KB | 23 Nov 2009 - 19:16 |
| Netcraft | 30 | 125.49 KB | 29 Nov 2009 - 17:12 |
| WallPaper (alias crawlpaper) | 25 | 8.69 MB | 29 Nov 2009 - 12:27 |
| NutchCVS | 24 | 404.14 KB | 29 Nov 2009 - 15:07 |
| Checkbot | 22 | 6.49 KB | 29 Nov 2009 - 03:21 |
| Cursor | 18 | 3.62 MB | 29 Nov 2009 - 19:24 |
| arianna.libero.it | 9+9 | 251.62 KB | 24 Nov 2009 - 14:59 |
| BBot | 17+1 | 5.48 MB | 30 Nov 2009 - 23:08 |
| BSpider | 1+16 | 10.78 KB | 29 Nov 2009 - 21:09 |
| SurveyBot | 16 | 61.50 KB | 25 Nov 2009 - 15:50 |
| ruffle SemanticWeb crawler | 13 | 53.59 KB | 16 Nov 2009 - 17:17 |
| Microsoft URL Control | 12 | 551.68 KB | 23 Nov 2009 - 20:35 |
| Grub.org | 11 | 87.99 KB | 19 Nov 2009 - 03:24 |
| YahooSeeker Yahoo! Blog crawler | 7+4 | 12.40 KB | 29 Nov 2009 - 22:15 |
| Findlinks | 8+1 | 76.61 KB | 30 Nov 2009 - 23:57 |
| EasyDL | 7 | 1.57 MB | 19 Nov 2009 - 19:17 |
| NewsGator Online | 6 | 0 | 29 Nov 2009 - 19:05 |
| SuperBot | 6 | 59.70 KB | 24 Nov 2009 - 03:39 |
| Girafabot | 0+6 | 2.26 KB | 24 Nov 2009 - 16:29 |
| OmniExplorer Bot | 3+1 | 34.96 KB | 24 Nov 2009 - 14:08 |
| W3C Validator | 4 | 11.70 KB | 18 Nov 2009 - 00:55 |
| Internet Shinchakubin | 4 | 343.41 KB | 27 Nov 2009 - 21:23 |
| LinkScan | 4 | 42.88 KB | 19 Nov 2009 - 15:05 |
| Susie | 3 | 209.22 KB | 30 Nov 2009 - 07:14 |
| SpiderMan | 0+3 | 1.13 KB | 30 Nov 2009 - 08:59 |
| lwp-request | 3 | 1.03 MB | 17 Nov 2009 - 07:48 |
| The Jubii Indexing Robot | 3 | 218.44 KB | 08 Nov 2009 - 15:22 |
| Holmes | 1+1 | 444.17 KB | 11 Nov 2009 - 14:03 |
| Feedburner | 2 | 678 Bytes | 18 Nov 2009 - 15:33 |
| Web Downloader | 2 | 1.63 MB | 29 Nov 2009 - 20:46 |
| HTMLParser | 2 | 18.75 KB | 16 Nov 2009 - 22:34 |
| LinkChecker | 1+1 | 692 Bytes | 16 Nov 2009 - 18:54 |
| Scooter | 2 | 9.05 KB | 09 Nov 2009 - 16:53 |
| Yahoo-MMCrawler | 1+1 | 49.22 KB | 27 Nov 2009 - 19:17 |
| arks | 2 | 45.17 KB | 11 Nov 2009 - 22:02 |
| lwp-trivial | 2 | 8.92 KB | 11 Nov 2009 - 09:19 |
| Calif | 1 | 126.29 KB | 06 Nov 2009 - 19:20 |
| FavOrg | 1 | 33.07 KB | 29 Nov 2009 - 14:45 |
| DNAbot | 0+1 | 386 Bytes | 19 Nov 2009 - 04:30 |
| Harvest | 1 | 926.68 KB | 11 Nov 2009 - 11:51 |
| The World Wide Web Worm | 1 | 32.09 KB | 22 Nov 2009 - 18:00 |
| UniversalFeedParser | 1 | 11.06 KB | 08 Nov 2009 - 12:20 |
| Sunrise | 1 | 9.42 KB | 30 Nov 2009 - 00:23 |
| TITAN | 1 | 1.63 MB | 15 Nov 2009 - 14:26 |
| mnoGoSearch search engine software | 1 | 6.41 KB | 20 Nov 2009 - 06:02 |
| MojeekBot | 1 | 41.47 KB | 05 Nov 2009 - 13:16 |
| Suke | 1 | 217.99 KB | 15 Nov 2009 - 05:20 |
| Perman surfer | 1 | 41.41 KB | 17 Nov 2009 - 16:43 |