| 97 different robots | Hits | Bandwidth | Last visit |
|---|
| Load Balancing Server | 185569 | 2.26 GB | 31 Dec 2009 - 23:59 |
| Googlebot | 94351+54 | 7.25 GB | 31 Dec 2009 - 23:59 |
| MSNBot | 79147+440 | 1.36 GB | 31 Dec 2009 - 23:59 |
| Yahoo Slurp | 78544+155 | 3.75 GB | 31 Dec 2009 - 23:58 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1852 | 699.17 KB | 31 Dec 2009 - 23:54 |
| Unknown robot (identified by 'crawl') | 12841+4162 | 169.50 MB | 31 Dec 2009 - 23:52 |
| Nagios | 19227 | 45.91 MB | 31 Dec 2009 - 23:51 |
| Yandex bot | 34430+139 | 1.72 GB | 31 Dec 2009 - 23:50 |
| Exabot | 2387+29 | 8.52 MB | 31 Dec 2009 - 23:47 |
| MLBot | 768+47 | 8.91 MB | 31 Dec 2009 - 23:35 |
| Voila | 6071+97 | 103.84 MB | 31 Dec 2009 - 23:33 |
| Unknown robot (identified by 'spider') | 4628+975 | 33.35 MB | 31 Dec 2009 - 23:24 |
| UP.Browser | 2144 | 574.76 MB | 31 Dec 2009 - 23:20 |
| Voyager | 20+8 | 1.12 MB | 31 Dec 2009 - 23:19 |
| Speedy Spider | 1067+237 | 8.45 MB | 31 Dec 2009 - 23:17 |
| BaiDuSpider | 1655+95 | 79.57 MB | 31 Dec 2009 - 23:15 |
| Nutch | 375+86 | 12.17 MB | 31 Dec 2009 - 23:14 |
| Java (Often spam bot) | 2001+15 | 168.02 MB | 31 Dec 2009 - 23:14 |
| Powermarks | 676 | 362.88 KB | 31 Dec 2009 - 23:14 |
| MSNBot-media | 50+11 | 10.04 MB | 31 Dec 2009 - 23:13 |
| CFNetwork | 1587 | 204.18 MB | 31 Dec 2009 - 23:02 |
| InfoBot | 171+6 | 1.39 MB | 31 Dec 2009 - 23:02 |
| The web archive (IA Archiver) | 0+288 | 108.56 KB | 31 Dec 2009 - 22:42 |
| WebCollage | 214 | 17.73 MB | 31 Dec 2009 - 22:05 |
| legs | 43+65 | 8.46 MB | 31 Dec 2009 - 21:44 |
| Jakarta commons-httpclient | 280+11 | 37.10 MB | 31 Dec 2009 - 21:42 |
| Yahoo! Slurp China | 285+123 | 7.85 MB | 31 Dec 2009 - 21:35 |
| Python-urllib | 480 | 148.63 MB | 31 Dec 2009 - 21:33 |
| Heritrix | 226+80 | 5.04 MB | 31 Dec 2009 - 21:09 |
| Unknown robot (identified by 'bot/' or 'bot-') | 1338+333 | 250.51 MB | 31 Dec 2009 - 21:00 |
| Unknown robot (identified by 'robot') | 10575+424 | 920.65 MB | 31 Dec 2009 - 20:26 |
| Ask | 1819+152 | 188.61 MB | 31 Dec 2009 - 20:22 |
| larbin | 34+23 | 3.36 MB | 31 Dec 2009 - 19:57 |
| Web Core / Roots | 142 | 230.55 MB | 31 Dec 2009 - 18:53 |
| Custo | 341+83 | 35.46 MB | 31 Dec 2009 - 15:37 |
| DoCoMo | 1111+37 | 410.94 MB | 31 Dec 2009 - 14:34 |
| FAST Enterprise Crawler | 741+5 | 15.49 MB | 31 Dec 2009 - 13:48 |
| MSIECrawler | 50+13 | 1.10 MB | 31 Dec 2009 - 13:43 |
| yacy | 68+95 | 5.78 MB | 31 Dec 2009 - 13:06 |
| Alexa (IA Archiver) | 342+80 | 8.72 MB | 31 Dec 2009 - 12:48 |
| Google AdSense | 42 | 1.06 MB | 31 Dec 2009 - 12:11 |
| BSpider | 1+18 | 20.23 KB | 31 Dec 2009 - 09:46 |
| Feedfetcher-Google | 116 | 20.69 MB | 31 Dec 2009 - 07:32 |
| VSE | 161 | 23.53 MB | 31 Dec 2009 - 06:53 |
| LinkWalker | 19+18 | 126.17 KB | 31 Dec 2009 - 05:04 |
| WordPress | 476 | 2.40 MB | 31 Dec 2009 - 04:59 |
| TencentTraveler | 239 | 55.65 MB | 31 Dec 2009 - 02:11 |
| Motor | 17 | 4.87 MB | 31 Dec 2009 - 01:06 |
| GigaBot | 1 | 10.47 KB | 31 Dec 2009 - 00:30 |
| Fish search | 5 | 291.86 KB | 30 Dec 2009 - 21:16 |
| Muncher | 2 | 5.42 KB | 30 Dec 2009 - 19:41 |
| BBot | 19 | 28.38 MB | 30 Dec 2009 - 10:00 |
| psbot | 813+30 | 3.69 MB | 30 Dec 2009 - 09:18 |
| WallPaper (alias crawlpaper) | 18 | 745.80 KB | 30 Dec 2009 - 08:51 |
| UCSD Crawl | 2 | 25.58 KB | 29 Dec 2009 - 16:48 |
| Xenu Link Sleuth | 35 | 9.74 KB | 29 Dec 2009 - 11:01 |
| Cursor | 19 | 1.29 MB | 28 Dec 2009 - 16:51 |
| Feedburner | 7 | 2.34 KB | 28 Dec 2009 - 05:13 |
| Vagabondo | 7+2 | 123.57 KB | 28 Dec 2009 - 05:00 |
| Microsoft URL Control | 29 | 5.42 MB | 27 Dec 2009 - 17:54 |
| Poppi | 1 | 4.01 KB | 27 Dec 2009 - 13:54 |
| MJ12bot | 439+9 | 2.36 MB | 27 Dec 2009 - 04:57 |
| SurveyBot | 9 | 29.06 KB | 26 Dec 2009 - 05:44 |
| Girafabot | 0+6 | 2.26 KB | 25 Dec 2009 - 12:03 |
| archive.org bot | 1+2 | 45.57 KB | 25 Dec 2009 - 08:51 |
| Susie | 2 | 54.20 KB | 25 Dec 2009 - 00:08 |
| Findlinks | 1+1 | 17.05 KB | 24 Dec 2009 - 07:50 |
| StackRambler | 0+4 | 1.51 KB | 23 Dec 2009 - 16:09 |
| arks | 0+1 | 424 Bytes | 23 Dec 2009 - 11:24 |
| Yahoo-MMCrawler | 2+2 | 98.44 KB | 22 Dec 2009 - 09:38 |
| FavOrg | 1 | 3.57 KB | 22 Dec 2009 - 04:10 |
| arianna.libero.it | 1+1 | 13.21 KB | 22 Dec 2009 - 00:27 |
| The World Wide Web Worm | 1 | 5.89 KB | 21 Dec 2009 - 18:37 |
| NewsGator Online | 4 | 0 | 21 Dec 2009 - 10:41 |
| DNAbot | 0+10 | 3.77 KB | 21 Dec 2009 - 06:03 |
| Netcraft | 10 | 31.57 KB | 20 Dec 2009 - 14:35 |
| SpiderMan | 13+9 | 91.17 KB | 18 Dec 2009 - 14:04 |
| Aport | 2 | 176.33 KB | 18 Dec 2009 - 11:23 |
| xirq | 1 | 217.99 KB | 18 Dec 2009 - 10:35 |
| YahooSeeker Yahoo! Blog crawler | 0+2 | 772 Bytes | 18 Dec 2009 - 00:12 |
| HTMLParser | 4 | 6.10 KB | 17 Dec 2009 - 16:06 |
| Gaisbot | 34+18 | 1.52 MB | 16 Dec 2009 - 04:47 |
| HTTrack off-line browser | 9+1 | 5.37 MB | 15 Dec 2009 - 08:27 |
| W3C Link Checker | 1+1 | 709 Bytes | 14 Dec 2009 - 18:27 |
| Internet Shinchakubin | 6 | 900.77 KB | 14 Dec 2009 - 13:49 |
| Holmes | 0+1 | 367 Bytes | 14 Dec 2009 - 11:05 |
| Web Downloader | 1 | 4.34 KB | 14 Dec 2009 - 07:40 |
| boitho.com-dc | 1 | 12.77 KB | 12 Dec 2009 - 11:17 |
| Scooter | 1 | 203.57 KB | 12 Dec 2009 - 09:45 |
| Checkbot | 13 | 3.83 KB | 12 Dec 2009 - 03:21 |
| NutchCVS | 7 | 103.38 KB | 08 Dec 2009 - 11:14 |
| WebVac | 4962+1 | 22.78 MB | 08 Dec 2009 - 02:07 |
| Turn It In | 11+1 | 85.73 KB | 07 Dec 2009 - 11:44 |
| SuperBot | 11 | 139.09 KB | 04 Dec 2009 - 21:38 |
| Patric | 9 | 27.45 KB | 04 Dec 2009 - 11:34 |
| JoBo Java Web Robot | 0+1 | 386 Bytes | 03 Dec 2009 - 08:18 |
| TITAN | 1 | 686.32 KB | 02 Dec 2009 - 03:32 |