| 100 different robots | Hits | Bandwidth | Last visit |
|---|
| Load Balancing Server | 699509 | 5.13 GB | 31 Dec 2009 - 23:59 |
| MSNBot | 639331+440 | 13.35 GB | 31 Dec 2009 - 23:59 |
| Googlebot | 603606+54 | 104.14 GB | 31 Dec 2009 - 23:59 |
| Unknown robot (identified by 'robot') | 167825+424 | 9.00 GB | 31 Dec 2009 - 23:59 |
| Yahoo Slurp | 144083+155 | 33.77 GB | 31 Dec 2009 - 23:59 |
| MLBot | 63688+47 | 601.10 MB | 31 Dec 2009 - 23:35 |
| Unknown robot (identified by 'crawl') | 51759+4157 | 1.39 GB | 31 Dec 2009 - 23:52 |
| Yandex bot | 44295+139 | 2.01 GB | 31 Dec 2009 - 23:50 |
| Nagios | 27401 | 143.24 MB | 31 Dec 2009 - 23:51 |
| Java (Often spam bot) | 17145+15 | 2.66 GB | 31 Dec 2009 - 23:57 |
| Exabot | 10460+29 | 96.93 MB | 31 Dec 2009 - 23:47 |
| Unknown robot (identified by 'spider') | 5700+975 | 43.20 MB | 31 Dec 2009 - 23:28 |
| Voila | 6286+96 | 116.79 MB | 31 Dec 2009 - 23:33 |
| WebVac | 4961+1 | 22.78 MB | 08 Dec 2009 - 02:07 |
| BaiDuSpider | 4004+95 | 144.37 MB | 31 Dec 2009 - 23:52 |
| FAST Enterprise Crawler | 4034+5 | 32.81 MB | 31 Dec 2009 - 14:04 |
| Ask | 2204+152 | 327.71 MB | 31 Dec 2009 - 20:22 |
| UP.Browser | 2162 | 608.66 MB | 31 Dec 2009 - 23:20 |
| Unknown robot (identified by 'bot/' or 'bot-') | 1642+332 | 290.36 MB | 31 Dec 2009 - 21:00 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1839 | 694.30 KB | 31 Dec 2009 - 23:54 |
| Speedy Spider | 1562+237 | 11.79 MB | 31 Dec 2009 - 23:17 |
| CFNetwork | 1678 | 949.77 MB | 31 Dec 2009 - 23:02 |
| MJ12bot | 1421+9 | 42.42 MB | 31 Dec 2009 - 09:31 |
| DoCoMo | 1108+37 | 409.93 MB | 31 Dec 2009 - 14:34 |
| Alexa (IA Archiver) | 846+80 | 47.03 MB | 31 Dec 2009 - 15:29 |
| psbot | 820+30 | 3.69 MB | 30 Dec 2009 - 09:18 |
| Turn It In | 687+1 | 11.42 MB | 25 Dec 2009 - 05:39 |
| Powermarks | 683 | 418.75 KB | 31 Dec 2009 - 23:14 |
| Python-urllib | 584 | 186.85 MB | 31 Dec 2009 - 21:33 |
| Nutch | 430+85 | 15.29 MB | 31 Dec 2009 - 23:14 |
| LiveJournal.com | 503 | 19.46 MB | 31 Dec 2009 - 23:10 |
| WordPress | 484 | 2.82 MB | 31 Dec 2009 - 04:59 |
| Custo | 386+83 | 63.56 MB | 31 Dec 2009 - 15:37 |
| Yahoo! Slurp China | 296+123 | 7.91 MB | 31 Dec 2009 - 21:35 |
| Jakarta commons-httpclient | 331+11 | 58.62 MB | 31 Dec 2009 - 22:15 |
| Heritrix | 236+80 | 5.16 MB | 31 Dec 2009 - 21:09 |
| The web archive (IA Archiver) | 0+288 | 108.56 KB | 31 Dec 2009 - 22:42 |
| WebCollage | 264 | 19.99 MB | 31 Dec 2009 - 22:05 |
| TencentTraveler | 245 | 56.12 MB | 31 Dec 2009 - 02:11 |
| Web Core / Roots | 205 | 293.66 MB | 31 Dec 2009 - 18:53 |
| InfoBot | 171+6 | 1.39 MB | 31 Dec 2009 - 23:02 |
| VSE | 176 | 46.25 MB | 31 Dec 2009 - 11:38 |
| yacy | 76+94 | 6.55 MB | 31 Dec 2009 - 13:06 |
| legs | 68+65 | 9.29 MB | 31 Dec 2009 - 21:44 |
| Feedfetcher-Google | 115 | 20.68 MB | 31 Dec 2009 - 07:32 |
| MSNBot-media | 65+11 | 10.52 MB | 31 Dec 2009 - 23:13 |
| larbin | 50+22 | 3.52 MB | 31 Dec 2009 - 19:57 |
| MSIECrawler | 59+13 | 2.35 MB | 31 Dec 2009 - 16:44 |
| Gaisbot | 34+18 | 1.52 MB | 16 Dec 2009 - 04:47 |
| Google AdSense | 42 | 1.06 MB | 31 Dec 2009 - 12:11 |
| Microsoft URL Control | 41 | 12.29 MB | 31 Dec 2009 - 15:35 |
| LinkWalker | 18+18 | 119.87 KB | 31 Dec 2009 - 05:04 |
| HTTrack off-line browser | 35+1 | 7.34 MB | 31 Dec 2009 - 19:24 |
| Xenu Link Sleuth | 35 | 9.74 KB | 29 Dec 2009 - 11:01 |
| Netcraft | 32 | 135.89 KB | 20 Dec 2009 - 14:35 |
| BBot | 28 | 29.59 MB | 30 Dec 2009 - 10:00 |
| Voyager | 20+8 | 1.12 MB | 31 Dec 2009 - 23:19 |
| WallPaper (alias crawlpaper) | 27 | 10.75 MB | 30 Dec 2009 - 08:51 |
| SpiderMan | 13+9 | 91.17 KB | 18 Dec 2009 - 14:04 |
| Cursor | 20 | 1.67 MB | 28 Dec 2009 - 16:51 |
| BSpider | 1+18 | 20.23 KB | 31 Dec 2009 - 09:46 |
| SuperBot | 17 | 152.47 KB | 18 Dec 2009 - 16:48 |
| Motor | 17 | 4.87 MB | 31 Dec 2009 - 01:06 |
| SurveyBot | 15 | 65.17 KB | 26 Dec 2009 - 05:44 |
| Checkbot | 13 | 3.83 KB | 12 Dec 2009 - 03:21 |
| DNAbot | 0+10 | 3.77 KB | 21 Dec 2009 - 06:03 |
| Fish search | 10 | 2.38 MB | 30 Dec 2009 - 21:16 |
| Patric | 9 | 27.45 KB | 04 Dec 2009 - 11:34 |
| Vagabondo | 7+2 | 123.57 KB | 28 Dec 2009 - 05:00 |
| Internet Shinchakubin | 7 | 911.99 KB | 25 Dec 2009 - 04:31 |
| Feedburner | 7 | 2.34 KB | 28 Dec 2009 - 05:13 |
| NutchCVS | 7 | 103.38 KB | 08 Dec 2009 - 11:14 |
| Girafabot | 0+6 | 2.26 KB | 25 Dec 2009 - 12:03 |
| StackRambler | 0+4 | 1.51 KB | 23 Dec 2009 - 16:09 |
| HTMLParser | 4 | 6.10 KB | 17 Dec 2009 - 16:06 |
| UCSD Crawl | 4 | 48.03 KB | 29 Dec 2009 - 16:48 |
| Yahoo-MMCrawler | 2+2 | 98.44 KB | 22 Dec 2009 - 09:38 |
| NewsGator Online | 3 | 0 | 12 Dec 2009 - 19:28 |
| YahooSeeker Yahoo! Blog crawler | 1+2 | 1.57 KB | 18 Dec 2009 - 00:12 |
| archive.org bot | 1+2 | 45.57 KB | 25 Dec 2009 - 08:51 |
| Susie | 2 | 54.20 KB | 25 Dec 2009 - 00:08 |
| Findlinks | 1+1 | 17.05 KB | 24 Dec 2009 - 07:50 |
| arianna.libero.it | 1+1 | 13.21 KB | 22 Dec 2009 - 00:27 |
| Muncher | 2 | 5.42 KB | 30 Dec 2009 - 19:41 |
| TITAN | 2 | 688.75 KB | 05 Dec 2009 - 09:20 |
| Aport | 2 | 176.33 KB | 18 Dec 2009 - 11:23 |
| W3C Link Checker | 1+1 | 709 Bytes | 14 Dec 2009 - 18:27 |
| arks | 1+1 | 11.62 KB | 23 Dec 2009 - 11:24 |
| Holmes | 0+1 | 367 Bytes | 14 Dec 2009 - 11:05 |
| FavOrg | 1 | 3.57 KB | 22 Dec 2009 - 04:10 |
| ASpider (Associative Spider) | 1 | 41.53 KB | 04 Dec 2009 - 20:48 |
| xirq | 1 | 217.99 KB | 18 Dec 2009 - 10:35 |
| GigaBot | 1 | 10.47 KB | 31 Dec 2009 - 00:30 |
| JoBo Java Web Robot | 0+1 | 386 Bytes | 03 Dec 2009 - 08:18 |
| The World Wide Web Worm | 1 | 5.89 KB | 21 Dec 2009 - 18:37 |
| Web Downloader | 1 | 4.34 KB | 14 Dec 2009 - 07:40 |
| boitho.com-dc | 1 | 12.77 KB | 12 Dec 2009 - 11:17 |
| Scooter | 1 | 203.57 KB | 12 Dec 2009 - 09:45 |
| Y!J Yahoo Japan | 1 | 106.12 KB | 03 Dec 2009 - 06:32 |
| Poppi | 1 | 4.01 KB | 27 Dec 2009 - 13:54 |