| 97 different robots | Hits | Bandwidth | Last visit |
|---|
| Load Balancing Server | 157035 | 1.88 GB | 30 Nov 2009 - 23:59 |
| Googlebot | 96096+49 | 4.90 GB | 30 Nov 2009 - 23:59 |
| MSNBot | 61868+682 | 373.85 MB | 30 Nov 2009 - 23:58 |
| Yahoo Slurp | 78475+189 | 3.91 GB | 30 Nov 2009 - 23:58 |
| Ask | 2563+147 | 178.92 MB | 30 Nov 2009 - 23:57 |
| Exabot | 2639+27 | 9.57 MB | 30 Nov 2009 - 23:57 |
| Voila | 4696+58 | 84.92 MB | 30 Nov 2009 - 23:53 |
| Google AdSense | 99 | 1.86 MB | 30 Nov 2009 - 23:51 |
| Nagios | 17366 | 41.31 MB | 30 Nov 2009 - 23:49 |
| Yandex bot | 3016+132 | 50.92 MB | 30 Nov 2009 - 23:47 |
| MLBot | 1859+46 | 26.02 MB | 30 Nov 2009 - 23:47 |
| Unknown robot (identified by hit on 'robots.txt') | 0+4461 | 1.68 MB | 30 Nov 2009 - 23:46 |
| Unknown robot (identified by 'bot/' or 'bot-') | 19474+323 | 352.06 MB | 30 Nov 2009 - 23:45 |
| Unknown robot (identified by 'crawl') | 15489+2979 | 240.70 MB | 30 Nov 2009 - 23:41 |
| WordPress | 311 | 5.59 MB | 30 Nov 2009 - 23:40 |
| UP.Browser | 1404 | 396.95 MB | 30 Nov 2009 - 23:38 |
| Powermarks | 548 | 184.83 KB | 30 Nov 2009 - 23:31 |
| BaiDuSpider | 1581+113 | 52.19 MB | 30 Nov 2009 - 23:29 |
| Unknown robot (identified by 'robot') | 25178+104 | 296.60 MB | 30 Nov 2009 - 23:19 |
| BBot | 7+1 | 3.64 MB | 30 Nov 2009 - 23:08 |
| Unknown robot (identified by 'spider') | 5356+990 | 24.58 MB | 30 Nov 2009 - 23:04 |
| Heritrix | 1441+22 | 89.94 MB | 30 Nov 2009 - 23:03 |
| Custo | 305+138 | 36.90 MB | 30 Nov 2009 - 22:27 |
| Web Core / Roots | 114 | 205.63 MB | 30 Nov 2009 - 22:17 |
| Java (Often spam bot) | 4368+5 | 100.19 MB | 30 Nov 2009 - 22:16 |
| Python-urllib | 1039+4 | 263.29 MB | 30 Nov 2009 - 21:54 |
| Nutch | 525+70 | 8.25 MB | 30 Nov 2009 - 21:08 |
| Jakarta commons-httpclient | 365+9 | 52.26 MB | 30 Nov 2009 - 19:49 |
| CFNetwork | 668 | 846.50 MB | 30 Nov 2009 - 19:48 |
| Alexa (IA Archiver) | 397+49 | 4.71 MB | 30 Nov 2009 - 19:14 |
| DoCoMo | 692+32 | 199.38 MB | 30 Nov 2009 - 19:00 |
| The web archive (IA Archiver) | 0+259 | 97.63 KB | 30 Nov 2009 - 18:49 |
| Feedfetcher-Google | 100 | 11.09 MB | 30 Nov 2009 - 18:32 |
| larbin | 17+23 | 196.55 KB | 30 Nov 2009 - 18:03 |
| Yahoo! Slurp China | 226+64 | 7.29 MB | 30 Nov 2009 - 16:30 |
| TencentTraveler | 224 | 19.04 MB | 30 Nov 2009 - 15:13 |
| Speedy Spider | 949+215 | 6.30 MB | 30 Nov 2009 - 13:27 |
| VSE | 139 | 13.60 MB | 30 Nov 2009 - 11:02 |
| legs | 21+35 | 664.73 KB | 30 Nov 2009 - 10:50 |
| yacy | 133+46 | 1.52 MB | 30 Nov 2009 - 10:38 |
| SpiderMan | 0+3 | 1.13 KB | 30 Nov 2009 - 08:59 |
| Susie | 2 | 207.09 KB | 30 Nov 2009 - 07:14 |
| Findlinks | 5+1 | 57.90 KB | 30 Nov 2009 - 00:31 |
| Fish search | 38 | 36.64 MB | 30 Nov 2009 - 00:23 |
| Sunrise | 1 | 9.42 KB | 30 Nov 2009 - 00:23 |
| YahooSeeker Yahoo! Blog crawler | 2+4 | 8.34 KB | 29 Nov 2009 - 22:15 |
| BSpider | 1+16 | 10.78 KB | 29 Nov 2009 - 21:09 |
| Web Downloader | 2 | 1.63 MB | 29 Nov 2009 - 20:46 |
| WebCollage | 78 | 8.14 MB | 29 Nov 2009 - 20:03 |
| Cursor | 17 | 939.61 KB | 29 Nov 2009 - 19:24 |
| NewsGator Online | 6 | 0 | 29 Nov 2009 - 19:05 |
| MSIECrawler | 53+24 | 3.87 MB | 29 Nov 2009 - 18:51 |
| HTTrack off-line browser | 15+7 | 2.30 MB | 29 Nov 2009 - 18:48 |
| Netcraft | 10 | 26.87 KB | 29 Nov 2009 - 17:12 |
| NutchCVS | 24 | 404.14 KB | 29 Nov 2009 - 15:07 |
| FavOrg | 1 | 33.07 KB | 29 Nov 2009 - 14:45 |
| WallPaper (alias crawlpaper) | 22 | 257.66 KB | 29 Nov 2009 - 12:27 |
| LinkWalker | 17+18 | 113.56 KB | 29 Nov 2009 - 06:16 |
| Checkbot | 22 | 6.49 KB | 29 Nov 2009 - 03:21 |
| Internet Shinchakubin | 3 | 211.20 KB | 27 Nov 2009 - 21:23 |
| Yahoo-MMCrawler | 1+1 | 49.22 KB | 27 Nov 2009 - 19:17 |
| Xenu Link Sleuth | 27 | 7.54 KB | 27 Nov 2009 - 18:32 |
| Motor | 32+1 | 2.26 MB | 27 Nov 2009 - 10:32 |
| MJ12bot | 703+10 | 4.20 MB | 27 Nov 2009 - 10:01 |
| SurveyBot | 12 | 37.42 KB | 25 Nov 2009 - 15:50 |
| psbot | 198+16 | 232.45 MB | 25 Nov 2009 - 14:01 |
| Girafabot | 0+6 | 2.26 KB | 24 Nov 2009 - 16:29 |
| arianna.libero.it | 9+9 | 251.62 KB | 24 Nov 2009 - 14:59 |
| OmniExplorer Bot | 3+1 | 34.96 KB | 24 Nov 2009 - 14:08 |
| SuperBot | 5 | 54.72 KB | 24 Nov 2009 - 03:39 |
| Microsoft URL Control | 7 | 494.48 KB | 23 Nov 2009 - 20:35 |
| Steeler | 16+1 | 302.64 KB | 23 Nov 2009 - 18:42 |
| GigaBot | 953+185 | 4.54 MB | 23 Nov 2009 - 08:21 |
| The World Wide Web Worm | 1 | 32.09 KB | 22 Nov 2009 - 18:00 |
| mnoGoSearch search engine software | 1 | 6.41 KB | 20 Nov 2009 - 06:02 |
| InfoBot | 52+3 | 256.86 KB | 19 Nov 2009 - 20:18 |
| EasyDL | 7 | 1.57 MB | 19 Nov 2009 - 19:17 |
| Turn It In | 14+2 | 85.82 KB | 19 Nov 2009 - 18:59 |
| LinkScan | 4 | 42.88 KB | 19 Nov 2009 - 15:05 |
| DNAbot | 0+1 | 386 Bytes | 19 Nov 2009 - 04:30 |
| Grub.org | 7 | 5.17 KB | 19 Nov 2009 - 03:24 |
| Feedburner | 2 | 678 Bytes | 18 Nov 2009 - 15:33 |
| W3C Validator | 4 | 11.70 KB | 18 Nov 2009 - 00:55 |
| lwp-request | 3 | 1.03 MB | 17 Nov 2009 - 07:48 |
| FAST Enterprise Crawler | 4083+14 | 346.33 MB | 17 Nov 2009 - 00:30 |
| HTMLParser | 2 | 18.75 KB | 16 Nov 2009 - 22:34 |
| LinkChecker | 1+1 | 692 Bytes | 16 Nov 2009 - 18:54 |
| Suke | 1 | 217.99 KB | 15 Nov 2009 - 05:20 |
| arks | 2 | 45.17 KB | 11 Nov 2009 - 22:02 |
| Holmes | 1+1 | 444.17 KB | 11 Nov 2009 - 14:03 |
| Harvest | 1 | 926.68 KB | 11 Nov 2009 - 11:51 |
| lwp-trivial | 2 | 8.92 KB | 11 Nov 2009 - 09:19 |
| Scooter | 2 | 9.05 KB | 09 Nov 2009 - 16:53 |
| The Jubii Indexing Robot | 3 | 218.44 KB | 08 Nov 2009 - 15:22 |
| UniversalFeedParser | 1 | 11.06 KB | 08 Nov 2009 - 12:20 |
| Calif | 1 | 126.29 KB | 06 Nov 2009 - 19:20 |
| WebVac | 127+1 | 2.09 MB | 04 Nov 2009 - 21:09 |