| 60 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 30101 | 9.30 GB | 31 Dec 2008 - 22:18 |
| MLBot | 226164 | 2.34 GB | 31 Dec 2008 - 22:17 |
| MSNBot | 44705 | 363.42 MB | 31 Dec 2008 - 22:17 |
| UP.Browser | 47 | 1.00 MB | 31 Dec 2008 - 22:17 |
| FAST Enterprise Crawler | 2061 | 33.25 MB | 31 Dec 2008 - 22:17 |
| Nagios | 4371 | 44.78 MB | 31 Dec 2008 - 22:08 |
| Googlebot | 5676 | 920.77 MB | 31 Dec 2008 - 22:08 |
| Speedy Spider | 98 | 2.39 MB | 31 Dec 2008 - 22:02 |
| MSNBot-media | 5002 | 1.28 GB | 31 Dec 2008 - 21:56 |
| Unknown robot (identified by 'crawl') | 3846 | 223.04 MB | 31 Dec 2008 - 21:47 |
| Voila | 165 | 7.14 MB | 31 Dec 2008 - 21:35 |
| BaiDuSpider | 741 | 8.32 MB | 31 Dec 2008 - 21:23 |
| Nutch | 112 | 1.25 MB | 31 Dec 2008 - 20:35 |
| Unknown robot (identified by 'spider') | 237 | 1.57 MB | 31 Dec 2008 - 20:32 |
| Netcraft | 16 | 90.95 KB | 31 Dec 2008 - 20:27 |
| Unknown robot (identified by 'bot/' or 'bot-') | 1483 | 17.22 MB | 31 Dec 2008 - 20:11 |
| Exabot | 246 | 1012.99 KB | 31 Dec 2008 - 18:49 |
| Java (Often spam bot) | 15862 | 7.34 MB | 31 Dec 2008 - 18:09 |
| Ask | 136 | 31.56 MB | 31 Dec 2008 - 17:48 |
| GigaBot | 29 | 1.33 MB | 31 Dec 2008 - 17:36 |
| Jakarta commons-httpclient | 474 | 1.64 MB | 31 Dec 2008 - 17:15 |
| CFNetwork | 45 | 216.73 MB | 31 Dec 2008 - 17:12 |
| MJ12bot | 737 | 22.75 MB | 31 Dec 2008 - 13:15 |
| Steeler | 1 | 2.15 KB | 31 Dec 2008 - 11:40 |
| Grub.org | 14 | 21.78 KB | 31 Dec 2008 - 07:06 |
| LiveJournal.com | 72 | 1.15 MB | 31 Dec 2008 - 04:37 |
| VSE | 18 | 188.53 KB | 31 Dec 2008 - 03:58 |
| Unknown robot (identified by 'robot') | 34156 | 196.31 MB | 31 Dec 2008 - 02:49 |
| yacy | 2 | 48.53 KB | 30 Dec 2008 - 15:40 |
| Asterias | 129 | 2.69 MB | 30 Dec 2008 - 15:24 |
| Yahoo! Slurp China | 17 | 66.61 KB | 30 Dec 2008 - 05:17 |
| Yandex bot | 5 | 54.72 KB | 30 Dec 2008 - 01:18 |
| Custo | 3 | 5.05 MB | 29 Dec 2008 - 21:46 |
| MSIECrawler | 3 | 51.02 KB | 29 Dec 2008 - 20:08 |
| Motor | 6 | 11.57 MB | 28 Dec 2008 - 19:14 |
| BSpider | 38 | 151.62 KB | 28 Dec 2008 - 06:52 |
| TencentTraveler | 1 | 701.55 KB | 26 Dec 2008 - 06:28 |
| Microsoft URL Control | 79 | 166.45 MB | 26 Dec 2008 - 00:59 |
| WebCollage | 11 | 377.47 KB | 25 Dec 2008 - 09:50 |
| Python-urllib | 639 | 3.55 MB | 23 Dec 2008 - 20:50 |
| DoCoMo | 27 | 433.31 KB | 23 Dec 2008 - 10:19 |
| Yahoo-MMCrawler | 10 | 4.01 MB | 23 Dec 2008 - 10:19 |
| HTTrack off-line browser | 12 | 289.44 MB | 21 Dec 2008 - 11:59 |
| Web Core / Roots | 1 | 0 | 20 Dec 2008 - 18:17 |
| Alexa (IA Archiver) | 26 | 947.96 KB | 19 Dec 2008 - 19:16 |
| Powermarks | 1 | 302 Bytes | 19 Dec 2008 - 05:54 |
| larbin | 4 | 130.66 KB | 16 Dec 2008 - 23:43 |
| Xenu Link Sleuth | 2 | 566 Bytes | 15 Dec 2008 - 12:12 |
| BBot | 2 | 785.76 KB | 15 Dec 2008 - 02:32 |
| boitho.com-dc | 34 | 102.14 KB | 14 Dec 2008 - 20:17 |
| psbot | 5 | 35.11 KB | 14 Dec 2008 - 00:29 |
| YahooSeeker Yahoo! Blog crawler | 1 | 1.82 KB | 13 Dec 2008 - 04:56 |
| SuperBot | 1 | 2.13 KB | 10 Dec 2008 - 06:24 |
| MojeekBot | 3 | 40.40 KB | 09 Dec 2008 - 10:27 |
| Feedburner | 1 | 347 Bytes | 08 Dec 2008 - 22:58 |
| Ocelli | 19 | 58.42 KB | 06 Dec 2008 - 14:10 |
| Fish search | 1 | 701.55 KB | 03 Dec 2008 - 22:55 |
| ConveraCrawler | 3 | 18.68 KB | 03 Dec 2008 - 20:11 |
| NG 1.x (Exalead) | 2 | 276.48 KB | 02 Dec 2008 - 16:01 |
| Voyager | 1 | 10.49 KB | 01 Dec 2008 - 03:04 |