| 96 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 146511+267 | 4.40 GB | 30 Apr 2009 - 23:31 |
| Googlebot | 69787+24 | 2.46 GB | 30 Apr 2009 - 23:31 |
| MSNBot | 32979+1030 | 1.57 GB | 30 Apr 2009 - 23:31 |
| Unknown robot (identified by 'robot') | 21267+60 | 491.32 MB | 30 Apr 2009 - 21:47 |
| Exabot | 20240+16 | 101.69 MB | 30 Apr 2009 - 01:53 |
| FAST Enterprise Crawler | 14450+21 | 1.13 GB | 30 Apr 2009 - 17:41 |
| Unknown robot (identified by 'crawl') | 11704+1338 | 145.31 MB | 30 Apr 2009 - 23:30 |
| MSNBot-media | 9862+2227 | 1.37 GB | 30 Apr 2009 - 23:29 |
| Nagios | 10935 | 26.27 MB | 30 Apr 2009 - 23:30 |
| Unknown robot (identified by 'spider') | 5866+4991 | 43.15 MB | 30 Apr 2009 - 23:27 |
| Yandex bot | 8844+96 | 6.91 MB | 30 Apr 2009 - 23:04 |
| Unknown robot (identified by 'bot/' or 'bot-') | 8212+54 | 75.07 MB | 30 Apr 2009 - 17:48 |
| WebVac | 5390+1 | 24.75 MB | 05 Apr 2009 - 10:04 |
| Ask | 4592+96 | 218.82 MB | 30 Apr 2009 - 23:19 |
| Voila | 4170+41 | 53.00 MB | 30 Apr 2009 - 23:24 |
| Unknown robot (identified by hit on 'robots.txt') | 0+3727 | 1.34 MB | 30 Apr 2009 - 22:31 |
| GigaBot | 1555+301 | 30.53 MB | 30 Apr 2009 - 14:46 |
| BaiDuSpider | 1456+42 | 14.76 MB | 30 Apr 2009 - 23:04 |
| MJ12bot | 1257+21 | 20.54 MB | 28 Apr 2009 - 00:33 |
| Alexa (IA Archiver) | 1006+81 | 52.03 MB | 30 Apr 2009 - 13:53 |
| Nutch | 470+62 | 7.72 MB | 29 Apr 2009 - 17:25 |
| larbin | 362+145 | 3.18 MB | 30 Apr 2009 - 21:48 |
| Turn It In | 496+3 | 12.67 MB | 25 Apr 2009 - 09:58 |
| Yahoo! Slurp China | 289+170 | 10.85 MB | 30 Apr 2009 - 20:19 |
| Speedy Spider | 394+53 | 18.79 MB | 30 Apr 2009 - 22:46 |
| Java (Often spam bot) | 397+25 | 22.16 MB | 30 Apr 2009 - 22:32 |
| CFNetwork | 405 | 124.85 MB | 30 Apr 2009 - 17:25 |
| Custo | 338+53 | 34.37 MB | 30 Apr 2009 - 16:46 |
| Gaisbot | 340+8 | 3.70 MB | 28 Apr 2009 - 07:22 |
| MLBot | 318+22 | 4.57 MB | 30 Apr 2009 - 19:33 |
| The web archive (IA Archiver) | 0+339 | 127.79 KB | 30 Apr 2009 - 18:53 |
| Powermarks | 287 | 302.90 KB | 30 Apr 2009 - 21:50 |
| WebCollage | 279 | 34.89 MB | 30 Apr 2009 - 21:33 |
| TencentTraveler | 226 | 33.42 MB | 30 Apr 2009 - 08:54 |
| Python-urllib | 205+1 | 45.75 MB | 30 Apr 2009 - 23:08 |
| Jakarta commons-httpclient | 169+17 | 36.64 MB | 30 Apr 2009 - 19:41 |
| Grub.org | 158 | 1.73 MB | 30 Apr 2009 - 19:17 |
| VSE | 155+3 | 7.54 MB | 27 Apr 2009 - 17:07 |
| UP.Browser | 156 | 6.07 MB | 30 Apr 2009 - 20:20 |
| WordPress | 141 | 2.40 MB | 30 Apr 2009 - 16:33 |
| yacy | 98+24 | 1.68 MB | 30 Apr 2009 - 18:54 |
| Feedfetcher-Google | 121 | 325.40 KB | 27 Apr 2009 - 17:32 |
| MSIECrawler | 80+28 | 2.58 MB | 30 Apr 2009 - 06:07 |
| UniversalFeedParser | 97 | 161.38 KB | 30 Apr 2009 - 23:01 |
| psbot | 77+6 | 43.56 KB | 26 Apr 2009 - 06:22 |
| Ocelli | 79 | 2.73 MB | 20 Apr 2009 - 16:48 |
| Motor | 54 | 1.60 MB | 26 Apr 2009 - 14:52 |
| LiveJournal.com | 52 | 628.48 KB | 03 Apr 2009 - 22:44 |
| NutchCVS | 49+1 | 397.76 KB | 30 Apr 2009 - 04:31 |
| InfoBot | 48 | 474.17 KB | 28 Apr 2009 - 06:51 |
| NewsGator Online | 47 | 0 | 28 Apr 2009 - 21:59 |
| BBot | 37 | 7.83 MB | 29 Apr 2009 - 15:03 |
| LinkWalker | 24+12 | 121.82 KB | 28 Apr 2009 - 01:28 |
| Voyager | 22+12 | 113.63 KB | 12 Apr 2009 - 11:47 |
| lwp-request | 26 | 48.15 KB | 30 Apr 2009 - 19:05 |
| Microsoft URL Control | 23 | 1.10 MB | 22 Apr 2009 - 22:07 |
| DoCoMo | 21 | 428.78 KB | 23 Apr 2009 - 16:24 |
| Cursor | 21 | 433.02 KB | 26 Apr 2009 - 13:42 |
| Web Core / Roots | 19 | 3.50 MB | 27 Apr 2009 - 12:38 |
| BlogSearch | 18 | 640.99 KB | 28 Apr 2009 - 10:05 |
| Fish search | 17 | 1.38 MB | 26 Apr 2009 - 02:23 |
| Google AdSense | 17 | 747.39 KB | 27 Apr 2009 - 10:11 |
| Heritrix | 10+5 | 353.88 KB | 21 Apr 2009 - 07:42 |
| HTTrack off-line browser | 10+4 | 1.61 MB | 28 Apr 2009 - 21:51 |
| Checkbot | 14 | 4.13 KB | 30 Apr 2009 - 03:27 |
| lwp-trivial | 14 | 1.36 MB | 29 Apr 2009 - 01:24 |
| legs | 7+6 | 5.00 MB | 30 Apr 2009 - 14:01 |
| Scooter | 4+8 | 127.12 KB | 30 Apr 2009 - 12:45 |
| BSpider | 6+4 | 4.64 MB | 29 Apr 2009 - 10:12 |
| SpiderMan | 3+6 | 30.27 KB | 12 Apr 2009 - 12:58 |
| Xenu Link Sleuth | 9 | 2.51 KB | 21 Apr 2009 - 15:16 |
| TITAN | 8 | 709.45 KB | 04 Apr 2009 - 15:25 |
| HTMLParser | 7 | 44.17 KB | 17 Apr 2009 - 16:01 |
| Y!J Yahoo Japan | 6+1 | 394.90 KB | 02 Apr 2009 - 14:58 |
| Combine System | 4+2 | 17.74 KB | 16 Apr 2009 - 11:56 |
| Girafabot | 0+5 | 1.88 KB | 27 Apr 2009 - 02:09 |
| Holmes | 3+1 | 1.53 MB | 29 Apr 2009 - 01:54 |
| W3C Validator | 4 | 14.50 KB | 06 Apr 2009 - 01:14 |
| Netcraft | 4 | 19.30 KB | 24 Apr 2009 - 16:45 |
| W3C jigsaw CSS Validator | 4 | 4.16 KB | 08 Apr 2009 - 13:46 |
| SuperBot | 3 | 1.59 MB | 28 Apr 2009 - 22:07 |
| Susie | 3 | 331.02 KB | 22 Apr 2009 - 06:03 |
| Yahoo-MMCrawler | 2+1 | 382.91 KB | 29 Apr 2009 - 23:18 |
| OmniExplorer Bot | 1+1 | 61.72 KB | 12 Apr 2009 - 06:31 |
| Shoutcast Directory Service | 2 | 130.05 KB | 06 Apr 2009 - 06:49 |
| Vagabondo | 0+2 | 772 Bytes | 07 Apr 2009 - 14:04 |
| Walhello appie | 1+1 | 13.09 KB | 05 Apr 2009 - 20:58 |
| W3C Link Checker | 0+2 | 848 Bytes | 17 Apr 2009 - 13:42 |
| MojeekBot | 1+1 | 1.66 KB | 01 Apr 2009 - 09:00 |
| FavOrg | 1 | 18.87 KB | 09 Apr 2009 - 11:23 |
| MagpieRSS | 1 | 6.58 KB | 17 Apr 2009 - 21:49 |
| NG 2.x (Exalead) | 0+1 | 386 Bytes | 24 Apr 2009 - 03:15 |
| ichiro | 1 | 1.56 MB | 19 Apr 2009 - 16:20 |
| YahooSeeker Yahoo! Blog crawler | 0+1 | 386 Bytes | 12 Apr 2009 - 23:23 |
| Emacs-w3 Search Engine | 1 | 12.71 KB | 16 Apr 2009 - 07:47 |
| MS SharePoint Portal Server - MS Search 4.0 Robot | 0+1 | 424 Bytes | 23 Apr 2009 - 22:56 |