| 96 different robots | Hits | Bandwidth | Last visit |
|---|
| Load Balancing Server | 699385 | 4.96 GB | 31 Jan 2010 - 23:59 |
| Googlebot | 583109+57 | 161.61 GB | 31 Jan 2010 - 23:59 |
| Yahoo Slurp | 167682+156 | 50.04 GB | 31 Jan 2010 - 23:59 |
| MLBot | 84929+44 | 626.11 MB | 31 Jan 2010 - 23:59 |
| MSNBot | 764313+2157 | 29.66 GB | 31 Jan 2010 - 23:59 |
| Turn It In | 459+1 | 14.21 MB | 31 Jan 2010 - 23:58 |
| Unknown robot (identified by 'robot') | 121037+266 | 4.23 GB | 31 Jan 2010 - 23:58 |
| Nagios | 27340 | 143.28 MB | 31 Jan 2010 - 23:56 |
| SpiderMan | 542+15 | 4.85 MB | 31 Jan 2010 - 23:56 |
| Unknown robot (identified by 'crawl') | 54544+8607 | 1.18 GB | 31 Jan 2010 - 23:52 |
| Ask | 3789+152 | 383.31 MB | 31 Jan 2010 - 23:39 |
| Speedy Spider | 2866+299 | 32.26 MB | 31 Jan 2010 - 23:38 |
| BaiDuSpider | 4276+89 | 137.76 MB | 31 Jan 2010 - 23:36 |
| Yahoo! Slurp China | 294+71 | 6.60 MB | 31 Jan 2010 - 23:35 |
| LiveJournal.com | 424 | 16.16 MB | 31 Jan 2010 - 23:31 |
| CFNetwork | 4027 | 995.16 MB | 31 Jan 2010 - 23:29 |
| TencentTraveler | 555 | 91.49 MB | 31 Jan 2010 - 23:27 |
| Unknown robot (identified by hit on 'robots.txt') | 0+2180 | 822.10 KB | 31 Jan 2010 - 23:27 |
| Alexa (IA Archiver) | 916+86 | 53.25 MB | 31 Jan 2010 - 23:25 |
| Yandex bot | 63195+162 | 3.52 GB | 31 Jan 2010 - 23:14 |
| Java (Often spam bot) | 14802+4 | 2.16 GB | 31 Jan 2010 - 23:10 |
| The web archive (IA Archiver) | 0+176 | 66.34 KB | 31 Jan 2010 - 23:07 |
| Unknown robot (identified by 'spider') | 6211+1117 | 108.83 MB | 31 Jan 2010 - 23:01 |
| MSNBot-media | 1294+287 | 83.10 MB | 31 Jan 2010 - 23:01 |
| Exabot | 18226+23 | 174.20 MB | 31 Jan 2010 - 23:01 |
| UP.Browser | 1340 | 439.69 MB | 31 Jan 2010 - 22:58 |
| Feedfetcher-Google | 94 | 12.05 MB | 31 Jan 2010 - 22:46 |
| Web Core / Roots | 272 | 422.24 MB | 31 Jan 2010 - 22:31 |
| Jakarta commons-httpclient | 383+9 | 91.83 MB | 31 Jan 2010 - 22:10 |
| Motor | 20 | 5.57 MB | 31 Jan 2010 - 21:45 |
| Custo | 389+93 | 1.39 GB | 31 Jan 2010 - 21:44 |
| Python-urllib | 1086+5 | 283.20 MB | 31 Jan 2010 - 21:33 |
| Powermarks | 509 | 410.90 KB | 31 Jan 2010 - 21:31 |
| Nutch | 490+77 | 30.26 MB | 31 Jan 2010 - 21:11 |
| WordPress | 492 | 935.47 KB | 31 Jan 2010 - 17:48 |
| VSE | 196 | 40.58 MB | 31 Jan 2010 - 16:33 |
| Unknown robot (identified by 'bot/' or 'bot-') | 6479+355 | 555.61 MB | 31 Jan 2010 - 15:45 |
| legs | 85+175 | 23.46 MB | 31 Jan 2010 - 15:35 |
| DoCoMo | 288+37 | 84.68 MB | 31 Jan 2010 - 14:38 |
| BSpider | 8+18 | 6.26 MB | 31 Jan 2010 - 13:21 |
| HTTrack off-line browser | 1114+4 | 149.23 MB | 31 Jan 2010 - 13:14 |
| MSIECrawler | 35+22 | 2.28 MB | 31 Jan 2010 - 12:34 |
| WallPaper (alias crawlpaper) | 33 | 1005.60 KB | 31 Jan 2010 - 12:13 |
| WebCollage | 45 | 1.76 MB | 31 Jan 2010 - 12:07 |
| yacy | 259+116 | 22.36 MB | 31 Jan 2010 - 11:33 |
| mnoGoSearch search engine software | 2 | 5.81 KB | 31 Jan 2010 - 08:20 |
| DNAbot | 1+2 | 18.50 KB | 31 Jan 2010 - 07:18 |
| Findlinks | 6+1 | 65.87 KB | 31 Jan 2010 - 06:46 |
| Microsoft URL Control | 47 | 9.54 MB | 31 Jan 2010 - 06:43 |
| LinkWalker | 15+14 | 99.53 KB | 31 Jan 2010 - 05:01 |
| Web Downloader | 5 | 21.65 KB | 31 Jan 2010 - 03:26 |
| MJ12bot | 1099+17 | 29.99 MB | 30 Jan 2010 - 23:39 |
| Fish search | 9 | 2.31 MB | 30 Jan 2010 - 11:32 |
| psbot | 1198+34 | 217.86 KB | 30 Jan 2010 - 06:21 |
| InfoBot | 298+2 | 2.47 MB | 30 Jan 2010 - 02:49 |
| Vagabondo | 0+1 | 386 Bytes | 29 Jan 2010 - 20:46 |
| larbin | 34+19 | 395.23 KB | 29 Jan 2010 - 15:15 |
| Heritrix | 59+14 | 6.11 MB | 29 Jan 2010 - 13:13 |
| Voila | 5026+85 | 69.07 MB | 29 Jan 2010 - 09:46 |
| Google AdSense | 45 | 1.39 MB | 29 Jan 2010 - 04:42 |
| Internet Shinchakubin | 9 | 430.19 KB | 29 Jan 2010 - 03:20 |
| Girafabot | 0+3 | 1.13 KB | 28 Jan 2010 - 19:38 |
| Scooter | 37 | 587.31 KB | 28 Jan 2010 - 17:25 |
| Xenu Link Sleuth | 30 | 8.01 KB | 28 Jan 2010 - 14:19 |
| W3C Validator | 14 | 65.88 KB | 28 Jan 2010 - 11:16 |
| HTMLParser | 7 | 745.34 KB | 28 Jan 2010 - 04:26 |
| BBot | 17 | 853.35 KB | 27 Jan 2010 - 21:21 |
| FavOrg | 2 | 66.14 KB | 27 Jan 2010 - 18:36 |
| LinkChecker | 0+1 | 386 Bytes | 27 Jan 2010 - 15:26 |
| Link Valet Online | 3 | 909 Bytes | 27 Jan 2010 - 13:10 |
| archive.org bot | 4+3 | 236.38 KB | 27 Jan 2010 - 11:17 |
| Cursor | 12 | 1.29 MB | 27 Jan 2010 - 06:13 |
| YahooSeeker Yahoo! Blog crawler | 1+3 | 547.68 KB | 27 Jan 2010 - 00:28 |
| ichiro | 0+1 | 386 Bytes | 26 Jan 2010 - 10:13 |
| FAST Enterprise Crawler | 11589+9 | 237.78 MB | 26 Jan 2010 - 06:23 |
| SurveyBot | 15 | 65.15 KB | 25 Jan 2010 - 17:31 |
| Susie | 6 | 88.33 KB | 25 Jan 2010 - 14:23 |
| Voyager | 53+3 | 875.61 KB | 25 Jan 2010 - 12:15 |
| DWCP (Dridus' Web Cataloging Project) | 1 | 14.82 KB | 25 Jan 2010 - 10:57 |
| SuperBot | 14 | 31.50 KB | 23 Jan 2010 - 09:28 |
| arks | 119+13 | 3.24 MB | 22 Jan 2010 - 06:26 |
| W3C jigsaw CSS Validator | 3 | 21.43 KB | 22 Jan 2010 - 00:19 |
| TITAN | 2 | 107.53 KB | 21 Jan 2010 - 16:26 |
| Netcraft | 35 | 120.67 KB | 21 Jan 2010 - 14:28 |
| Ingrid | 1 | 130.75 KB | 21 Jan 2010 - 11:27 |
| Feedburner | 5 | 1.68 KB | 20 Jan 2010 - 15:03 |
| Muncher | 2 | 1.09 KB | 19 Jan 2010 - 22:53 |
| W3C Link Checker | 0+1 | 424 Bytes | 19 Jan 2010 - 03:47 |
| ruffle SemanticWeb crawler | 7 | 80.48 KB | 18 Jan 2010 - 15:30 |
| Boris | 4 | 6.38 KB | 17 Jan 2010 - 13:20 |
| ASpider (Associative Spider) | 1 | 9.42 KB | 13 Jan 2010 - 04:14 |
| StackRambler | 1 | 35.53 KB | 12 Jan 2010 - 05:22 |
| EasyDL | 1 | 27.69 KB | 11 Jan 2010 - 09:06 |
| VORTEX | 3 | 35.24 KB | 10 Jan 2010 - 08:23 |
| WebVac | 3511+1 | 16.76 MB | 06 Jan 2010 - 22:05 |
| GigaBot | 1 | 10.47 KB | 03 Jan 2010 - 00:33 |