| 118 different robots | Hits | Bandwidth | Last visit |
|---|
| MLBot | 132826+40 | 733.70 MB | 30 Nov 2008 - 23:38 |
| psbot | 6220+237 | 802.20 MB | 30 Nov 2008 - 23:38 |
| Yahoo Slurp | 255469+1044 | 21.20 GB | 30 Nov 2008 - 23:38 |
| Googlebot | 112374+47 | 4.45 GB | 30 Nov 2008 - 23:38 |
| Speedy Spider | 702+94 | 32.34 MB | 30 Nov 2008 - 23:37 |
| MSNBot | 122117+836 | 1.56 GB | 30 Nov 2008 - 23:36 |
| Nagios | 17452 | 44.78 MB | 30 Nov 2008 - 23:34 |
| Unknown robot (identified by hit on 'robots.txt') | 0+2647 | 866.42 KB | 30 Nov 2008 - 23:33 |
| MSNBot-media | 22540+3107 | 6.17 GB | 30 Nov 2008 - 23:31 |
| Ask | 11541+145 | 844.24 MB | 30 Nov 2008 - 23:20 |
| Grub.org | 135+6 | 1.84 MB | 30 Nov 2008 - 23:19 |
| BaiDuSpider | 3195+44 | 36.78 MB | 30 Nov 2008 - 23:10 |
| Asterias | 856 | 16.79 MB | 30 Nov 2008 - 22:36 |
| BlogPulse ISSpider intelliseek.com | 46+23 | 1.99 MB | 30 Nov 2008 - 22:35 |
| Bloglines | 26 | 2.04 MB | 30 Nov 2008 - 22:18 |
| GigaBot | 779+75 | 12.26 MB | 30 Nov 2008 - 22:17 |
| Unknown robot (identified by 'crawl') | 3526+272 | 562.36 MB | 30 Nov 2008 - 22:16 |
| Biz360 spider | 56 | 5.37 MB | 30 Nov 2008 - 22:15 |
| Yahoo! Slurp China | 608+88 | 12.28 MB | 30 Nov 2008 - 22:12 |
| Alexa (IA Archiver) | 618+44 | 8.78 MB | 30 Nov 2008 - 22:12 |
| Unknown robot (identified by 'robot') | 21402+421 | 161.80 MB | 30 Nov 2008 - 21:39 |
| TencentTraveler | 137 | 39.07 MB | 30 Nov 2008 - 21:26 |
| Voyager | 835+11 | 13.90 MB | 30 Nov 2008 - 21:25 |
| Feedfetcher-Google | 190 | 624.05 KB | 30 Nov 2008 - 21:09 |
| Unknown robot (identified by 'spider') | 3990+831 | 37.26 MB | 30 Nov 2008 - 21:02 |
| Java (Often spam bot) | 26377+8 | 94.02 MB | 30 Nov 2008 - 20:25 |
| larbin | 357+21 | 1.51 MB | 30 Nov 2008 - 19:59 |
| boitho.com-dc | 95 | 746.29 KB | 30 Nov 2008 - 19:53 |
| LiveJournal.com | 942 | 9.55 MB | 30 Nov 2008 - 19:46 |
| The World Wide Web Worm | 28 | 9.42 KB | 30 Nov 2008 - 19:19 |
| BSpider | 638+8 | 692.79 KB | 30 Nov 2008 - 19:15 |
| lwp-request | 52 | 73.51 KB | 30 Nov 2008 - 19:05 |
| MSIECrawler | 57+84 | 5.62 MB | 30 Nov 2008 - 18:49 |
| Python-urllib | 282+17 | 2.59 MB | 30 Nov 2008 - 18:17 |
| Voila | 7185+79 | 154.00 MB | 30 Nov 2008 - 18:08 |
| Unknown robot (identified by 'bot/' or 'bot-') | 2013+95 | 61.22 MB | 30 Nov 2008 - 18:00 |
| LinkWalker | 9+3 | 30.45 KB | 30 Nov 2008 - 16:34 |
| Jakarta commons-httpclient | 132+14 | 7.82 MB | 30 Nov 2008 - 16:29 |
| WebCollage | 366 | 31.93 MB | 30 Nov 2008 - 16:18 |
| Nutch | 1137+95 | 64.02 MB | 30 Nov 2008 - 15:35 |
| Zeus Webster Pro | 5 | 59.54 KB | 30 Nov 2008 - 15:13 |
| CFNetwork | 190 | 284.86 MB | 30 Nov 2008 - 14:14 |
| VSE | 638+4 | 38.28 MB | 30 Nov 2008 - 13:00 |
| Combine System | 0+2 | 848 Bytes | 30 Nov 2008 - 10:28 |
| NewsGator Online | 199 | 0 | 30 Nov 2008 - 05:41 |
| WordPress | 57 | 365.11 KB | 30 Nov 2008 - 04:53 |
| Heritrix | 9+15 | 274.58 KB | 30 Nov 2008 - 04:29 |
| Checkbot | 23 | 6.78 KB | 30 Nov 2008 - 03:21 |
| Yandex bot | 2376+24 | 47.44 MB | 29 Nov 2008 - 19:32 |
| The web archive (IA Archiver) | 0+368 | 138.72 KB | 29 Nov 2008 - 19:03 |
| DoCoMo | 25+1 | 144.21 KB | 29 Nov 2008 - 16:59 |
| BlogSearch | 12 | 427.32 KB | 29 Nov 2008 - 15:52 |
| StackRambler | 3+8 | 874.45 KB | 29 Nov 2008 - 15:38 |
| Custo | 52 | 13.00 MB | 29 Nov 2008 - 14:14 |
| Ocelli | 89+1 | 5.14 MB | 29 Nov 2008 - 11:24 |
| Xenu Link Sleuth | 35 | 9.23 KB | 29 Nov 2008 - 10:36 |
| HTTrack off-line browser | 63+7 | 24.37 MB | 29 Nov 2008 - 10:28 |
| ConveraCrawler | 93+1 | 1.89 MB | 29 Nov 2008 - 05:45 |
| lwp-trivial | 6+1 | 538.57 KB | 29 Nov 2008 - 05:31 |
| Motor | 15 | 30.46 KB | 29 Nov 2008 - 04:50 |
| Powermarks | 39 | 27.25 KB | 29 Nov 2008 - 03:57 |
| archive.org bot | 5+6 | 564.60 KB | 29 Nov 2008 - 01:49 |
| Snappy | 7 | 122.03 KB | 28 Nov 2008 - 20:31 |
| UP.Browser | 91 | 1.61 MB | 28 Nov 2008 - 18:23 |
| BBot | 45 | 5.92 MB | 28 Nov 2008 - 14:53 |
| Exabot | 3243+18 | 29.42 MB | 28 Nov 2008 - 14:41 |
| yacy | 35+4 | 2.35 MB | 28 Nov 2008 - 11:53 |
| MS SharePoint Portal Server - MS Search 4.0 Robot | 2+1 | 537.58 KB | 28 Nov 2008 - 10:08 |
| Google AdSense | 15 | 410.41 KB | 28 Nov 2008 - 06:17 |
| EasyDL | 4 | 337.67 KB | 28 Nov 2008 - 02:42 |
| Fish search | 45 | 16.19 MB | 28 Nov 2008 - 02:40 |
| Turn It In | 696+4 | 25.80 MB | 28 Nov 2008 - 00:26 |
| Holmes | 13+8 | 7.62 MB | 27 Nov 2008 - 22:55 |
| arks | 1 | 305 Bytes | 27 Nov 2008 - 12:27 |
| MJ12bot | 1308+27 | 16.55 MB | 27 Nov 2008 - 10:58 |
| Gaisbot | 9+11 | 1.05 MB | 25 Nov 2008 - 14:36 |
| LinkChecker | 5+2 | 205.40 KB | 21 Nov 2008 - 09:21 |
| SpiderMan | 85+9 | 1.01 MB | 20 Nov 2008 - 20:03 |
| OmniExplorer Bot | 330+3 | 3.20 MB | 20 Nov 2008 - 14:45 |
| Scooter | 0+32 | 12.06 KB | 19 Nov 2008 - 14:42 |
| Web Core / Roots | 8 | 117.93 KB | 19 Nov 2008 - 14:35 |
| Netcraft | 10 | 13.53 KB | 19 Nov 2008 - 11:04 |
| W3C Validator | 3 | 9.64 KB | 18 Nov 2008 - 22:28 |
| Microsoft URL Control | 8 | 336.56 KB | 18 Nov 2008 - 20:04 |
| SurveyBot | 6 | 69.13 KB | 18 Nov 2008 - 19:44 |
| NG 2.x (Exalead) | 2+1 | 537.59 KB | 18 Nov 2008 - 04:21 |
| Boris | 5 | 117.92 KB | 17 Nov 2008 - 19:57 |
| aipbot | 6+6 | 374.88 KB | 17 Nov 2008 - 19:04 |
| Seekbot | 1+1 | 1.27 KB | 17 Nov 2008 - 13:56 |
| LinkScan | 4 | 105.03 KB | 17 Nov 2008 - 05:52 |
| Internet Shinchakubin | 5 | 135.14 KB | 16 Nov 2008 - 13:50 |
| SuperBot | 12 | 4.90 MB | 16 Nov 2008 - 04:35 |
| Wells Search | 17 | 102.56 KB | 15 Nov 2008 - 19:58 |
| mnoGoSearch search engine software | 1 | 591 Bytes | 15 Nov 2008 - 18:34 |
| W3C Link Checker | 0+1 | 424 Bytes | 15 Nov 2008 - 13:33 |
| MSRBOT | 13+7 | 1.29 MB | 15 Nov 2008 - 08:48 |
| Cursor | 5 | 21.22 KB | 13 Nov 2008 - 20:01 |
| YahooSeeker Yahoo! Blog crawler | 0+2 | 772 Bytes | 12 Nov 2008 - 21:43 |
| FAST Enterprise Crawler | 1+2 | 4.20 KB | 12 Nov 2008 - 19:44 |
| Shoutcast Directory Service | 1 | 18.65 KB | 12 Nov 2008 - 10:18 |
| Vagabondo | 1+1 | 13.62 KB | 12 Nov 2008 - 00:44 |
| ichiro | 222+12 | 2.81 MB | 11 Nov 2008 - 07:28 |
| Feedburner | 55 | 18.37 KB | 11 Nov 2008 - 00:12 |
| Load Balancing Server | 93194 | 953.38 MB | 11 Nov 2008 - 00:12 |
| MagpieRSS | 2 | 26.46 KB | 10 Nov 2008 - 16:13 |
| MojeekBot | 3+3 | 46.75 KB | 10 Nov 2008 - 11:14 |
| Fluid Dynamics Search Engine robot | 1 | 2.15 KB | 10 Nov 2008 - 08:54 |
| BlogBridge Service | 2 | 26.65 KB | 09 Nov 2008 - 05:21 |
| InfoBot | 1+1 | 13.09 KB | 08 Nov 2008 - 05:28 |
| PHP version tracker | 2 | 508 Bytes | 06 Nov 2008 - 20:00 |
| Argus | 1 | 482.81 KB | 06 Nov 2008 - 16:04 |
| WebVac | 5425+1 | 27.23 MB | 06 Nov 2008 - 04:30 |
| Missigua_Locator | 1 | 33.08 KB | 05 Nov 2008 - 16:49 |
| HTMLParser | 2 | 7.26 KB | 05 Nov 2008 - 08:51 |
| Walhello appie | 1 | 11.53 KB | 03 Nov 2008 - 20:44 |
| W3C jigsaw CSS Validator | 2 | 7.64 KB | 03 Nov 2008 - 00:07 |
| FavOrg | 11 | 350.15 KB | 02 Nov 2008 - 22:08 |
| Pioneer | 1 | 79.86 KB | 02 Nov 2008 - 16:47 |