| 63 different robots | Hits | Bandwidth | Last visit |
|---|
| Load Balancing Server | 994930 | 6.40 GB | 31 Oct 2009 - 23:59 |
| MSNBot | 670522 | 14.92 GB | 31 Oct 2009 - 23:59 |
| Googlebot | 631038 | 97.15 GB | 31 Oct 2009 - 23:59 |
| Unknown robot (identified by 'crawl') | 169337 | 19.61 GB | 31 Oct 2009 - 23:38 |
| MLBot | 101452 | 1.29 GB | 31 Oct 2009 - 22:47 |
| Unknown robot (identified by 'robot') | 100743 | 2.49 GB | 31 Oct 2009 - 23:59 |
| FAST Enterprise Crawler | 51661 | 1.09 GB | 31 Oct 2009 - 23:58 |
| HTTrack off-line browser | 35429 | 6.12 GB | 31 Oct 2009 - 23:07 |
| Yahoo Slurp | 29195 | 9.87 GB | 31 Oct 2009 - 23:59 |
| Java (Often spam bot) | 20120 | 3.46 GB | 31 Oct 2009 - 23:29 |
| Nagios | 7204 | 85.45 MB | 31 Oct 2009 - 23:45 |
| Unknown robot (identified by 'bot/' or 'bot-') | 4783 | 700.35 MB | 31 Oct 2009 - 17:45 |
| Exabot | 2700 | 62.27 MB | 31 Oct 2009 - 22:19 |
| MJ12bot | 2239 | 84.07 MB | 31 Oct 2009 - 08:39 |
| BaiDuSpider | 1891 | 25.48 MB | 31 Oct 2009 - 23:23 |
| Unknown robot (identified by 'spider') | 918 | 7.66 MB | 31 Oct 2009 - 19:56 |
| Yahoo-MMCrawler | 736 | 322.07 MB | 09 Oct 2009 - 19:11 |
| Yandex bot | 640 | 3.37 MB | 31 Oct 2009 - 19:54 |
| LiveJournal.com | 620 | 24.28 MB | 31 Oct 2009 - 23:25 |
| Speedy Spider | 461 | 2.26 MB | 31 Oct 2009 - 19:19 |
| Ask | 389 | 82.44 MB | 31 Oct 2009 - 21:56 |
| Jakarta commons-httpclient | 233 | 81.48 MB | 31 Oct 2009 - 23:18 |
| Voila | 207 | 10.87 MB | 31 Oct 2009 - 23:16 |
| Heritrix | 203 | 2.33 MB | 26 Oct 2009 - 13:21 |
| Turn It In | 186 | 6.36 MB | 23 Oct 2009 - 11:33 |
| CFNetwork | 135 | 2.15 GB | 31 Oct 2009 - 14:53 |
| Nutch | 91 | 4.85 MB | 30 Oct 2009 - 12:51 |
| Python-urllib | 88 | 77.10 MB | 31 Oct 2009 - 21:54 |
| Alexa (IA Archiver) | 72 | 16.28 MB | 31 Oct 2009 - 02:58 |
| Custo | 43 | 33.42 MB | 31 Oct 2009 - 17:20 |
| Ocelli | 38 | 122.82 KB | 14 Oct 2009 - 16:31 |
| legs | 30 | 1.11 MB | 27 Oct 2009 - 22:48 |
| GigaBot | 27 | 135.67 KB | 31 Oct 2009 - 16:21 |
| UP.Browser | 26 | 16.49 MB | 31 Oct 2009 - 18:17 |
| Web Core / Roots | 25 | 60.58 MB | 31 Oct 2009 - 21:10 |
| DoCoMo | 22 | 218.66 KB | 28 Oct 2009 - 22:44 |
| Netcraft | 21 | 103.61 KB | 20 Oct 2009 - 08:21 |
| WordPress | 19 | 42.36 MB | 26 Oct 2009 - 01:05 |
| larbin | 18 | 425.56 KB | 31 Oct 2009 - 09:22 |
| MSIECrawler | 17 | 1.37 MB | 28 Oct 2009 - 14:06 |
| yacy | 15 | 993.39 KB | 31 Oct 2009 - 22:34 |
| BBot | 13 | 1.68 MB | 27 Oct 2009 - 23:43 |
| WallPaper (alias crawlpaper) | 11 | 7.91 MB | 26 Oct 2009 - 10:45 |
| Yahoo! Slurp China | 11 | 48.48 KB | 25 Oct 2009 - 03:33 |
| VSE | 10 | 15.09 MB | 31 Oct 2009 - 15:28 |
| Microsoft URL Control | 9 | 784.67 KB | 23 Oct 2009 - 22:01 |
| TencentTraveler | 8 | 27.26 MB | 31 Oct 2009 - 01:33 |
| Grub.org | 7 | 3.11 KB | 25 Oct 2009 - 01:44 |
| WebCollage | 6 | 263.40 KB | 18 Oct 2009 - 21:45 |
| Fish search | 4 | 1.50 MB | 26 Oct 2009 - 21:49 |
| Dumbot | 4 | 2.09 MB | 29 Oct 2009 - 04:18 |
| SurveyBot | 3 | 33.67 KB | 25 Oct 2009 - 19:29 |
| Cursor | 3 | 4.65 MB | 28 Oct 2009 - 01:01 |
| Google AdSense | 3 | 568.71 KB | 06 Oct 2009 - 08:13 |
| Powermarks | 2 | 20.08 KB | 31 Oct 2009 - 07:48 |
| Combine System | 2 | 13.05 KB | 03 Oct 2009 - 02:06 |
| Z-Add Link Checker | 1 | 181 Bytes | 29 Oct 2009 - 11:33 |
| mnoGoSearch search engine software | 1 | 11.22 KB | 18 Oct 2009 - 18:46 |
| Y!J Yahoo Japan | 1 | 701.51 KB | 08 Oct 2009 - 04:11 |
| Xenu Link Sleuth | 1 | 283 Bytes | 16 Oct 2009 - 13:00 |
| Internet Shinchakubin | 1 | 668.08 KB | 08 Oct 2009 - 06:43 |
| lwp-trivial | 1 | 11.22 KB | 20 Oct 2009 - 21:42 |
| Robozilla | 1 | 2.15 KB | 03 Oct 2009 - 00:20 |