99 different robots | Hits | Bandwidth | Last visit |
MSNBot | 217645+1068 | 13.59 GB | 30 Apr 2009 - 23:31 |
Yahoo Slurp | 163628+293 | 17.62 GB | 30 Apr 2009 - 23:31 |
Googlebot | 83003+26 | 5.82 GB | 30 Apr 2009 - 23:31 |
Unknown robot (identified by 'robot') | 45536+64 | 674.84 MB | 30 Apr 2009 - 21:47 |
FAST Enterprise Crawler | 38012+21 | 3.28 GB | 30 Apr 2009 - 23:31 |
MLBot | 31484+23 | 243.56 MB | 30 Apr 2009 - 19:33 |
Exabot | 20357+19 | 102.31 MB | 30 Apr 2009 - 01:53 |
Unknown robot (identified by 'crawl') | 17387+1371 | 358.47 MB | 30 Apr 2009 - 23:30 |
MSNBot-media | 15995+2235 | 2.56 GB | 30 Apr 2009 - 23:29 |
Nagios | 15644 | 78.75 MB | 30 Apr 2009 - 23:30 |
Java (Often spam bot) | 12976+25 | 1000.92 MB | 30 Apr 2009 - 23:32 |
Unknown robot (identified by 'spider') | 6195+4994 | 47.71 MB | 30 Apr 2009 - 23:30 |
Unknown robot (identified by 'bot/' or 'bot-') | 10975+60 | 122.18 MB | 30 Apr 2009 - 18:09 |
Yandex bot | 8895+106 | 7.17 MB | 30 Apr 2009 - 23:04 |
WebVac | 5390+1 | 24.75 MB | 05 Apr 2009 - 10:04 |
Ask | 4739+98 | 256.08 MB | 30 Apr 2009 - 23:19 |
Voila | 4288+43 | 58.93 MB | 30 Apr 2009 - 23:24 |
MJ12bot | 3872+21 | 119.95 MB | 28 Apr 2009 - 01:52 |
Unknown robot (identified by hit on 'robots.txt') | 0+3736 | 1.35 MB | 30 Apr 2009 - 22:31 |
GigaBot | 1605+301 | 31.79 MB | 30 Apr 2009 - 14:49 |
BaiDuSpider | 1639+43 | 17.91 MB | 30 Apr 2009 - 23:04 |
Alexa (IA Archiver) | 1070+81 | 56.13 MB | 30 Apr 2009 - 13:53 |
Turn It In | 690+3 | 13.77 MB | 25 Apr 2009 - 09:58 |
LiveJournal.com | 644 | 23.77 MB | 30 Apr 2009 - 23:16 |
Speedy Spider | 559+53 | 20.74 MB | 30 Apr 2009 - 22:46 |
Nutch | 549+62 | 9.92 MB | 29 Apr 2009 - 17:25 |
larbin | 421+145 | 4.00 MB | 30 Apr 2009 - 21:48 |
CFNetwork | 502 | 912.81 MB | 30 Apr 2009 - 21:38 |
Yahoo! Slurp China | 311+170 | 11.20 MB | 30 Apr 2009 - 22:44 |
Custo | 357+54 | 37.53 MB | 30 Apr 2009 - 18:07 |
Gaisbot | 382+8 | 6.37 MB | 29 Apr 2009 - 03:58 |
Jakarta commons-httpclient | 329+17 | 97.87 MB | 30 Apr 2009 - 19:41 |
The web archive (IA Archiver) | 0+339 | 127.79 KB | 30 Apr 2009 - 18:53 |
Python-urllib | 299+1 | 69.41 MB | 30 Apr 2009 - 23:08 |
Powermarks | 287 | 302.90 KB | 30 Apr 2009 - 21:50 |
WebCollage | 284 | 35.14 MB | 30 Apr 2009 - 21:33 |
TencentTraveler | 234 | 35.92 MB | 30 Apr 2009 - 08:54 |
yacy | 166+24 | 3.42 GB | 30 Apr 2009 - 18:54 |
Feedfetcher-Google | 180 | 801.86 KB | 27 Apr 2009 - 17:32 |
Grub.org | 168 | 1.75 MB | 30 Apr 2009 - 19:17 |
UP.Browser | 162 | 7.21 MB | 30 Apr 2009 - 20:20 |
VSE | 158+3 | 8.16 MB | 30 Apr 2009 - 09:42 |
WordPress | 148 | 14.74 MB | 30 Apr 2009 - 16:33 |
Voyager | 111+12 | 1009.48 KB | 12 Apr 2009 - 11:47 |
MSIECrawler | 83+28 | 11.98 MB | 30 Apr 2009 - 06:07 |
SpiderMan | 96+6 | 695.64 KB | 12 Apr 2009 - 12:58 |
Ocelli | 98 | 2.79 MB | 27 Apr 2009 - 04:50 |
UniversalFeedParser | 97 | 161.38 KB | 30 Apr 2009 - 23:01 |
psbot | 77+6 | 43.56 KB | 26 Apr 2009 - 06:22 |
Motor | 55 | 1.60 MB | 26 Apr 2009 - 14:52 |
NutchCVS | 51+1 | 402.06 KB | 30 Apr 2009 - 04:31 |
InfoBot | 48 | 474.17 KB | 28 Apr 2009 - 06:51 |
NewsGator Online | 47 | 0 | 28 Apr 2009 - 21:59 |
BBot | 43 | 9.49 MB | 29 Apr 2009 - 15:03 |
LinkWalker | 24+12 | 121.82 KB | 28 Apr 2009 - 01:28 |
TITAN | 33 | 92.24 MB | 30 Apr 2009 - 07:25 |
lwp-request | 26 | 48.15 KB | 30 Apr 2009 - 19:05 |
Microsoft URL Control | 23 | 1.10 MB | 22 Apr 2009 - 22:07 |
DoCoMo | 23 | 433.14 KB | 23 Apr 2009 - 16:24 |
Netcraft | 22 | 112.75 KB | 24 Apr 2009 - 16:45 |
lwp-trivial | 22 | 6.85 MB | 29 Apr 2009 - 01:24 |
Cursor | 21 | 433.02 KB | 26 Apr 2009 - 13:42 |
Web Core / Roots | 20 | 5.61 MB | 27 Apr 2009 - 12:38 |
Fish search | 18 | 1.38 MB | 26 Apr 2009 - 02:23 |
BlogSearch | 18 | 640.99 KB | 28 Apr 2009 - 10:05 |
Google AdSense | 17 | 747.39 KB | 27 Apr 2009 - 10:11 |
Heritrix | 11+5 | 364.37 KB | 21 Apr 2009 - 07:42 |
HTTrack off-line browser | 11+4 | 1.61 MB | 28 Apr 2009 - 21:51 |
Checkbot | 14 | 4.13 KB | 30 Apr 2009 - 03:27 |
legs | 8+6 | 73.74 MB | 30 Apr 2009 - 14:01 |
Scooter | 4+8 | 127.12 KB | 30 Apr 2009 - 12:45 |
BSpider | 6+6 | 4.64 MB | 29 Apr 2009 - 10:12 |
Xenu Link Sleuth | 9 | 2.51 KB | 21 Apr 2009 - 15:16 |
HTMLParser | 7 | 44.17 KB | 17 Apr 2009 - 16:01 |
Y!J Yahoo Japan | 6+1 | 394.90 KB | 02 Apr 2009 - 14:58 |
SuperBot | 6 | 1.65 MB | 28 Apr 2009 - 22:07 |
Combine System | 4+2 | 17.74 KB | 16 Apr 2009 - 11:56 |
Susie | 5 | 335.27 KB | 22 Apr 2009 - 06:03 |
Girafabot | 0+5 | 1.88 KB | 27 Apr 2009 - 02:09 |
MojeekBot | 4+1 | 83.86 KB | 14 Apr 2009 - 21:48 |
Holmes | 3+1 | 1.53 MB | 29 Apr 2009 - 01:54 |
W3C Validator | 4 | 14.50 KB | 06 Apr 2009 - 01:14 |
W3C jigsaw CSS Validator | 4 | 4.16 KB | 08 Apr 2009 - 13:46 |
W3C Link Checker | 2+2 | 1.38 KB | 25 Apr 2009 - 00:19 |
SurveyBot | 2+1 | 24.78 KB | 01 Apr 2009 - 08:03 |
Internet Shinchakubin | 3 | 5.29 MB | 24 Apr 2009 - 23:18 |
Walhello appie | 2+1 | 24.55 KB | 05 Apr 2009 - 20:58 |
Yahoo-MMCrawler | 2+1 | 382.91 KB | 29 Apr 2009 - 23:18 |
OmniExplorer Bot | 1+1 | 61.72 KB | 12 Apr 2009 - 06:31 |
Shoutcast Directory Service | 2 | 130.05 KB | 06 Apr 2009 - 06:49 |
NG 2.x (Exalead) | 0+2 | 2.23 KB | 24 Apr 2009 - 03:15 |
Vagabondo | 0+2 | 772 Bytes | 07 Apr 2009 - 14:04 |
FavOrg | 1 | 18.87 KB | 09 Apr 2009 - 11:23 |
ht://Dig | 1 | 2.15 KB | 21 Apr 2009 - 21:25 |
MagpieRSS | 1 | 6.58 KB | 17 Apr 2009 - 21:49 |
ichiro | 1 | 1.56 MB | 19 Apr 2009 - 16:20 |
YahooSeeker Yahoo! Blog crawler | 0+1 | 386 Bytes | 12 Apr 2009 - 23:23 |
Emacs-w3 Search Engine | 1 | 12.71 KB | 16 Apr 2009 - 07:47 |
MS SharePoint Portal Server - MS Search 4.0 Robot | 0+1 | 424 Bytes | 23 Apr 2009 - 22:56 |