| 98 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 480944+57 | 21.95 GB | 30 Apr 2010 - 23:59 |
| Yahoo Slurp | 70558+144 | 7.78 GB | 30 Apr 2010 - 23:59 |
| Load Balancing Server | 82028 | 1.00 GB | 30 Apr 2010 - 23:59 |
| CFNetwork | 2226 | 759.46 MB | 30 Apr 2010 - 23:59 |
| FAST Enterprise Crawler | 37+1 | 500.96 KB | 30 Apr 2010 - 23:59 |
| Unknown robot (identified by 'robot') | 7317+166 | 326.50 MB | 30 Apr 2010 - 23:58 |
| Voila | 5202+84 | 192.67 MB | 30 Apr 2010 - 23:57 |
| MSNBot | 62470+1264 | 4.76 GB | 30 Apr 2010 - 23:56 |
| Yahoo! Slurp China | 213+48 | 6.88 MB | 30 Apr 2010 - 23:56 |
| Nagios | 16857 | 40.64 MB | 30 Apr 2010 - 23:55 |
| MSNBot-media | 5735+3069 | 819.71 MB | 30 Apr 2010 - 23:52 |
| Unknown robot (identified by 'spider') | 3791+1008 | 66.69 MB | 30 Apr 2010 - 23:52 |
| Unknown robot (identified by 'crawl') | 12758+5972 | 134.38 MB | 30 Apr 2010 - 23:49 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1032 | 385.93 KB | 30 Apr 2010 - 23:44 |
| Unknown robot (identified by 'bot/' or 'bot-') | 2453+326 | 73.31 MB | 30 Apr 2010 - 23:40 |
| Powermarks | 617 | 6.23 MB | 30 Apr 2010 - 23:25 |
| MSIECrawler | 321+452 | 7.82 MB | 30 Apr 2010 - 23:14 |
| UP.Browser | 1287 | 388.80 MB | 30 Apr 2010 - 23:12 |
| Ask | 1426+125 | 130.27 MB | 30 Apr 2010 - 23:09 |
| Yandex bot | 4289+127 | 86.22 MB | 30 Apr 2010 - 23:08 |
| Alexa (IA Archiver) | 466+82 | 9.78 MB | 30 Apr 2010 - 23:05 |
| TencentTraveler | 101 | 49.01 MB | 30 Apr 2010 - 22:31 |
| Web Core / Roots | 231 | 358.80 MB | 30 Apr 2010 - 22:27 |
| Jakarta commons-httpclient | 587+18 | 106.23 MB | 30 Apr 2010 - 22:26 |
| Custo | 368+55 | 21.78 MB | 30 Apr 2010 - 22:25 |
| Feedfetcher-Google | 602 | 45.09 MB | 30 Apr 2010 - 22:23 |
| BaiDuSpider | 1808+112 | 62.57 MB | 30 Apr 2010 - 22:16 |
| yacy | 80+98 | 1.25 MB | 30 Apr 2010 - 21:49 |
| Java (Often spam bot) | 1708+8 | 319.17 MB | 30 Apr 2010 - 21:37 |
| MLBot | 463+27 | 19.06 MB | 30 Apr 2010 - 21:19 |
| mnoGoSearch search engine software | 2 | 11.18 KB | 30 Apr 2010 - 20:15 |
| Nutch | 180+91 | 2.68 MB | 30 Apr 2010 - 20:05 |
| Microsoft URL Control | 22 | 578.88 KB | 30 Apr 2010 - 20:04 |
| Xenu Link Sleuth | 36 | 10.04 KB | 30 Apr 2010 - 19:14 |
| psbot | 397+42 | 13.79 MB | 30 Apr 2010 - 18:40 |
| WebCollage | 34 | 4.25 MB | 30 Apr 2010 - 18:34 |
| larbin | 42+50 | 893.17 KB | 30 Apr 2010 - 18:07 |
| Voyager | 19 | 1.57 MB | 30 Apr 2010 - 18:04 |
| Python-urllib | 470+4 | 265.13 MB | 30 Apr 2010 - 18:04 |
| Y!J Yahoo Japan | 3+2 | 32.16 KB | 30 Apr 2010 - 18:03 |
| WordPress | 641 | 4.10 MB | 30 Apr 2010 - 18:03 |
| DoCoMo | 31+39 | 3.00 MB | 30 Apr 2010 - 16:58 |
| Gaisbot | 2+1 | 9.46 KB | 30 Apr 2010 - 16:33 |
| The web archive (IA Archiver) | 0+141 | 53.15 KB | 30 Apr 2010 - 14:37 |
| HTTrack off-line browser | 99+41 | 14.78 MB | 30 Apr 2010 - 14:32 |
| BSpider | 3+18 | 22.04 KB | 30 Apr 2010 - 08:31 |
| Motor | 41 | 2.89 MB | 30 Apr 2010 - 07:59 |
| Lycos | 8+8 | 539.27 KB | 30 Apr 2010 - 07:33 |
| VSE | 162 | 9.67 MB | 30 Apr 2010 - 07:26 |
| legs | 111+101 | 1.85 MB | 30 Apr 2010 - 07:10 |
| Exabot | 3040+27 | 12.73 MB | 30 Apr 2010 - 04:05 |
| Boris | 1 | 44.85 KB | 30 Apr 2010 - 00:41 |
| MSRBOT | 20+21 | 3.36 MB | 29 Apr 2010 - 21:37 |
| W3C Validator | 532 | 1.43 MB | 29 Apr 2010 - 20:48 |
| SpiderMan | 548+25 | 4.26 MB | 29 Apr 2010 - 19:56 |
| Google AdSense | 32 | 1018.34 KB | 29 Apr 2010 - 18:18 |
| Speedy Spider | 1541+322 | 20.66 MB | 29 Apr 2010 - 12:38 |
| Vagabondo | 1+1 | 203.91 KB | 29 Apr 2010 - 11:59 |
| Heritrix | 6+7 | 332.76 KB | 29 Apr 2010 - 11:15 |
| Link Valet Online | 2 | 609 Bytes | 29 Apr 2010 - 10:43 |
| Turn It In | 1203+13 | 23.97 MB | 29 Apr 2010 - 05:28 |
| BBot | 8 | 439.69 KB | 28 Apr 2010 - 20:50 |
| Findlinks | 8+1 | 49.88 KB | 28 Apr 2010 - 18:15 |
| Girafabot | 0+4 | 1.51 KB | 28 Apr 2010 - 16:07 |
| SurveyBot | 8 | 61.85 KB | 28 Apr 2010 - 14:27 |
| WallPaper (alias crawlpaper) | 31 | 3.42 MB | 28 Apr 2010 - 13:00 |
| Web Downloader | 2 | 4.32 KB | 28 Apr 2010 - 12:47 |
| MS SharePoint Portal Server - MS Search 4.0 Robot | 2 | 74.79 KB | 28 Apr 2010 - 00:16 |
| EasyDL | 17 | 572.59 KB | 27 Apr 2010 - 22:57 |
| Internet Shinchakubin | 2 | 36.53 KB | 27 Apr 2010 - 17:35 |
| GigaBot | 0+1 | 386 Bytes | 27 Apr 2010 - 17:08 |
| archive.org bot | 4+2 | 196.36 KB | 27 Apr 2010 - 12:14 |
| YahooSeeker Yahoo! Blog crawler | 0+3 | 1.13 KB | 27 Apr 2010 - 01:52 |
| StackRambler | 0+3 | 1.13 KB | 27 Apr 2010 - 01:08 |
| FavOrg | 3 | 115.45 KB | 26 Apr 2010 - 09:30 |
| Susie | 4 | 1.77 MB | 26 Apr 2010 - 03:16 |
| arianna.libero.it | 0+1 | 386 Bytes | 25 Apr 2010 - 09:46 |
| ichiro | 4+3 | 20.00 KB | 25 Apr 2010 - 02:41 |
| OmniExplorer Bot | 1 | 9.75 KB | 24 Apr 2010 - 19:17 |
| Sunrise | 4 | 410.00 KB | 22 Apr 2010 - 14:57 |
| arks | 1+5 | 2.37 KB | 22 Apr 2010 - 14:43 |
| Checkbot | 1 | 304 Bytes | 22 Apr 2010 - 12:43 |
| InfoBot | 203+1 | 4.55 MB | 22 Apr 2010 - 05:42 |
| Fish search | 3 | 73.81 KB | 20 Apr 2010 - 18:10 |
| Patric | 3 | 286.43 KB | 20 Apr 2010 - 17:02 |
| MJ12bot | 666+12 | 6.77 MB | 20 Apr 2010 - 05:49 |
| NetMechanic | 3+3 | 1.91 KB | 20 Apr 2010 - 02:16 |
| NG 1.x (Exalead) | 5 | 221.54 KB | 18 Apr 2010 - 21:18 |
| Netcraft | 5 | 25.39 KB | 18 Apr 2010 - 17:24 |
| W3C Link Checker | 2+2 | 1.38 KB | 18 Apr 2010 - 16:31 |
| Fast-Webcrawler | 1 | 6.22 KB | 18 Apr 2010 - 09:38 |
| CipinetBot | 1 | 654 Bytes | 18 Apr 2010 - 07:55 |
| Occam | 1 | 33.09 KB | 16 Apr 2010 - 09:09 |
| Feedburner | 3 | 1.01 KB | 14 Apr 2010 - 11:00 |
| W3C jigsaw CSS Validator | 2 | 765 Bytes | 12 Apr 2010 - 13:10 |
| Pioneer | 2 | 107.53 KB | 08 Apr 2010 - 16:24 |
| lwp-request | 46 | 104.81 KB | 07 Apr 2010 - 11:03 |
| WebVac | 5452+1 | 24.89 MB | 07 Apr 2010 - 04:43 |