| 64 different robots | Hits | Bandwidth | Last visit |
|---|
| MLBot | 476788 | 4.09 GB | 31 Jul 2009 - 23:59 |
| Yahoo Slurp | 27240 | 9.09 GB | 31 Jul 2009 - 23:59 |
| MSNBot | 424282 | 29.67 GB | 31 Jul 2009 - 23:59 |
| Load Balancing Server | 811666 | 5.26 GB | 31 Jul 2009 - 23:59 |
| FAST Enterprise Crawler | 12595 | 942.78 MB | 31 Jul 2009 - 23:59 |
| Nagios | 8171 | 91.33 MB | 31 Jul 2009 - 23:43 |
| Googlebot | 8066 | 1.00 GB | 31 Jul 2009 - 23:40 |
| CFNetwork | 95 | 1.26 GB | 31 Jul 2009 - 23:26 |
| BaiDuSpider | 4268 | 866.00 MB | 31 Jul 2009 - 23:21 |
| Java (Often spam bot) | 25145 | 2.34 GB | 31 Jul 2009 - 23:15 |
| MJ12bot | 1390 | 50.08 MB | 31 Jul 2009 - 23:12 |
| LiveJournal.com | 587 | 23.01 MB | 31 Jul 2009 - 23:05 |
| Ask | 321 | 43.08 MB | 31 Jul 2009 - 22:44 |
| GigaBot | 46 | 147.53 KB | 31 Jul 2009 - 22:27 |
| Unknown robot (identified by 'spider') | 630 | 17.65 MB | 31 Jul 2009 - 22:09 |
| Unknown robot (identified by 'robot') | 36670 | 436.40 MB | 31 Jul 2009 - 21:40 |
| Voila | 206 | 13.51 MB | 31 Jul 2009 - 21:18 |
| Python-urllib | 166 | 111.18 MB | 31 Jul 2009 - 21:10 |
| larbin | 997 | 4.08 MB | 31 Jul 2009 - 20:30 |
| Yandex bot | 732 | 3.23 MB | 31 Jul 2009 - 19:52 |
| Unknown robot (identified by 'bot/' or 'bot-') | 1343 | 10.20 MB | 31 Jul 2009 - 18:29 |
| Nutch | 72 | 1.57 MB | 31 Jul 2009 - 17:52 |
| Custo | 40 | 23.52 MB | 31 Jul 2009 - 16:44 |
| Exabot | 300 | 36.77 MB | 31 Jul 2009 - 16:22 |
| Unknown robot (identified by 'crawl') | 2679 | 77.51 MB | 31 Jul 2009 - 13:39 |
| Jakarta commons-httpclient | 116 | 34.25 MB | 31 Jul 2009 - 11:08 |
| WallPaper (alias crawlpaper) | 2 | 3.28 MB | 31 Jul 2009 - 10:21 |
| DoCoMo | 4813 | 23.25 MB | 31 Jul 2009 - 08:24 |
| Grub.org | 9 | 4.67 KB | 31 Jul 2009 - 06:05 |
| Speedy Spider | 241 | 5.58 MB | 31 Jul 2009 - 01:21 |
| Yahoo-MMCrawler | 385 | 108.62 MB | 30 Jul 2009 - 19:05 |
| Alexa (IA Archiver) | 33 | 7.78 MB | 30 Jul 2009 - 00:32 |
| WebCollage | 8 | 61.29 KB | 29 Jul 2009 - 17:57 |
| SuperBot | 7 | 53.63 KB | 29 Jul 2009 - 17:39 |
| Xenu Link Sleuth | 4 | 890 Bytes | 29 Jul 2009 - 13:48 |
| Yahoo! Slurp China | 21 | 81.25 KB | 29 Jul 2009 - 07:21 |
| Internet Shinchakubin | 4 | 226.41 KB | 27 Jul 2009 - 22:49 |
| WordPress | 13 | 278.72 KB | 26 Jul 2009 - 18:04 |
| ichiro | 9675 | 2.99 GB | 26 Jul 2009 - 15:31 |
| SpiderMan | 1 | 41.06 KB | 26 Jul 2009 - 10:37 |
| TencentTraveler | 6 | 19.81 MB | 24 Jul 2009 - 10:27 |
| Ocelli | 24 | 71.12 KB | 23 Jul 2009 - 11:05 |
| Google AdSense | 2 | 21.78 KB | 23 Jul 2009 - 00:42 |
| lwp-trivial | 7 | 6.05 KB | 22 Jul 2009 - 07:49 |
| Web Core / Roots | 6 | 14.31 MB | 22 Jul 2009 - 00:57 |
| UP.Browser | 9 | 19.51 MB | 21 Jul 2009 - 20:03 |
| yacy | 340 | 3.21 MB | 20 Jul 2009 - 15:31 |
| VSE | 6 | 14.42 MB | 20 Jul 2009 - 06:13 |
| Web Downloader | 1 | 41.12 KB | 19 Jul 2009 - 16:57 |
| Metaspinner | 4 | 7.40 KB | 19 Jul 2009 - 15:50 |
| Netcraft | 23 | 87.85 KB | 18 Jul 2009 - 12:08 |
| legs | 16 | 10.96 MB | 17 Jul 2009 - 13:17 |
| MSNBot-media | 18269 | 1.71 GB | 17 Jul 2009 - 11:22 |
| VORTEX | 5 | 52.37 KB | 15 Jul 2009 - 19:28 |
| Gaisbot | 2 | 3.25 KB | 15 Jul 2009 - 08:56 |
| Cursor | 2 | 498.91 KB | 13 Jul 2009 - 21:02 |
| TITAN | 5 | 746.28 KB | 13 Jul 2009 - 12:31 |
| BBot | 6 | 1.24 MB | 13 Jul 2009 - 06:55 |
| YahooSeeker Yahoo! Blog crawler | 10 | 2.04 MB | 13 Jul 2009 - 05:01 |
| Microsoft URL Control | 1 | 10.47 KB | 11 Jul 2009 - 12:55 |
| Turn It In | 341 | 6.24 MB | 09 Jul 2009 - 07:52 |
| Y!J Yahoo Japan | 1 | 701.51 KB | 03 Jul 2009 - 04:11 |
| MSIECrawler | 1 | 2.18 KB | 03 Jul 2009 - 02:30 |
| GoForIt.com | 2 | 4.29 KB | 02 Jul 2009 - 16:25 |