| 57 different robots | Hits | Bandwidth | Last visit |
|---|
| MSNBot | 560384 | 12.00 GB | 31 Dec 2009 - 23:59 |
| Load Balancing Server | 514398 | 2.87 GB | 31 Dec 2009 - 23:59 |
| Googlebot | 509348 | 96.90 GB | 31 Dec 2009 - 23:59 |
| Unknown robot (identified by 'robot') | 157303 | 8.10 GB | 31 Dec 2009 - 23:59 |
| Yahoo Slurp | 65653 | 30.03 GB | 31 Dec 2009 - 23:59 |
| MLBot | 62928 | 592.21 MB | 31 Dec 2009 - 14:51 |
| Unknown robot (identified by 'crawl') | 38932 | 1.22 GB | 31 Dec 2009 - 23:21 |
| Java (Often spam bot) | 15148 | 2.50 GB | 31 Dec 2009 - 23:57 |
| Yandex bot | 9892 | 296.09 MB | 31 Dec 2009 - 23:50 |
| Nagios | 8214 | 97.40 MB | 31 Dec 2009 - 23:46 |
| Exabot | 8076 | 88.43 MB | 31 Dec 2009 - 15:31 |
| FAST Enterprise Crawler | 3294 | 17.31 MB | 31 Dec 2009 - 14:04 |
| BaiDuSpider | 2354 | 64.86 MB | 31 Dec 2009 - 23:52 |
| Unknown robot (identified by 'spider') | 1069 | 9.84 MB | 31 Dec 2009 - 23:28 |
| MJ12bot | 981 | 39.94 MB | 31 Dec 2009 - 09:31 |
| Turn It In | 674 | 11.33 MB | 25 Dec 2009 - 05:39 |
| LiveJournal.com | 504 | 19.50 MB | 31 Dec 2009 - 23:10 |
| Alexa (IA Archiver) | 503 | 38.30 MB | 31 Dec 2009 - 15:29 |
| Speedy Spider | 495 | 3.33 MB | 31 Dec 2009 - 22:29 |
| Ask | 387 | 139.82 MB | 31 Dec 2009 - 19:22 |
| Unknown robot (identified by 'bot/' or 'bot-') | 299 | 39.84 MB | 31 Dec 2009 - 05:39 |
| Voila | 214 | 12.68 MB | 31 Dec 2009 - 15:06 |
| Python-urllib | 104 | 38.22 MB | 31 Dec 2009 - 17:36 |
| CFNetwork | 91 | 745.59 MB | 31 Dec 2009 - 07:03 |
| Web Core / Roots | 63 | 63.11 MB | 31 Dec 2009 - 13:21 |
| Nutch | 56 | 3.13 MB | 31 Dec 2009 - 15:10 |
| Jakarta commons-httpclient | 51 | 21.51 MB | 31 Dec 2009 - 22:15 |
| WebCollage | 51 | 2.30 MB | 31 Dec 2009 - 02:52 |
| Custo | 42 | 28.09 MB | 29 Dec 2009 - 16:50 |
| HTTrack off-line browser | 26 | 1.97 MB | 31 Dec 2009 - 19:24 |
| legs | 25 | 851.85 KB | 31 Dec 2009 - 07:43 |
| UP.Browser | 24 | 35.90 MB | 30 Dec 2009 - 18:43 |
| Netcraft | 21 | 103.51 KB | 19 Dec 2009 - 13:19 |
| larbin | 16 | 162.86 KB | 30 Dec 2009 - 12:51 |
| MSNBot-media | 15 | 483.70 KB | 31 Dec 2009 - 18:02 |
| VSE | 15 | 22.71 MB | 31 Dec 2009 - 11:38 |
| Microsoft URL Control | 12 | 6.87 MB | 31 Dec 2009 - 15:35 |
| yacy | 11 | 900.03 KB | 29 Dec 2009 - 00:18 |
| Yahoo! Slurp China | 11 | 57.56 KB | 31 Dec 2009 - 12:13 |
| Heritrix | 10 | 131.46 KB | 30 Dec 2009 - 04:24 |
| MSIECrawler | 10 | 1.25 MB | 31 Dec 2009 - 16:44 |
| WallPaper (alias crawlpaper) | 9 | 10.02 MB | 25 Dec 2009 - 17:07 |
| BBot | 9 | 1.21 MB | 30 Dec 2009 - 02:21 |
| Powermarks | 8 | 68.67 KB | 30 Dec 2009 - 11:23 |
| WordPress | 8 | 429.63 KB | 28 Dec 2009 - 03:40 |
| psbot | 7 | 0 | 03 Dec 2009 - 22:16 |
| TencentTraveler | 6 | 480.73 KB | 21 Dec 2009 - 09:47 |
| SuperBot | 6 | 13.38 KB | 18 Dec 2009 - 16:48 |
| Fish search | 5 | 2.10 MB | 24 Dec 2009 - 03:56 |
| SurveyBot | 3 | 33.67 KB | 25 Dec 2009 - 04:48 |
| UCSD Crawl | 2 | 22.45 KB | 28 Dec 2009 - 06:56 |
| TITAN | 1 | 2.43 KB | 05 Dec 2009 - 09:20 |
| ASpider (Associative Spider) | 1 | 41.53 KB | 04 Dec 2009 - 20:48 |
| Cursor | 1 | 385.30 KB | 19 Dec 2009 - 14:52 |
| Y!J Yahoo Japan | 1 | 106.12 KB | 03 Dec 2009 - 06:32 |
| arks | 1 | 11.21 KB | 14 Dec 2009 - 07:35 |
| Internet Shinchakubin | 1 | 11.22 KB | 25 Dec 2009 - 04:31 |