69 different robots | Hits | Bandwidth | Last visit |
Googlebot | 679629+25 | 420.65 GB | 28 Feb 2010 - 23:55 |
Load Balancing Server | 470424 | 1.65 GB | 28 Feb 2010 - 23:59 |
MSNBot | 430263+202 | 21.53 GB | 28 Feb 2010 - 23:25 |
Unknown robot (identified by 'robot') | 128128+40 | 1.80 GB | 28 Feb 2010 - 23:58 |
Yahoo Slurp | 61435+37 | 99.23 GB | 28 Feb 2010 - 23:55 |
MLBot | 42937+14 | 330.43 MB | 28 Feb 2010 - 18:13 |
Unknown robot (identified by 'crawl') | 21576+630 | 473.51 MB | 28 Feb 2010 - 23:49 |
Java (Often spam bot) | 12464 | 1020.00 MB | 28 Feb 2010 - 22:56 |
Nagios | 7228 | 85.83 MB | 28 Feb 2010 - 23:31 |
Yandex bot | 3937+12 | 131.86 MB | 28 Feb 2010 - 22:40 |
MSNBot-media | 1928+178 | 439.61 MB | 28 Feb 2010 - 23:23 |
BaiDuSpider | 1759+26 | 49.28 MB | 28 Feb 2010 - 23:26 |
Unknown robot (identified by 'bot/' or 'bot-') | 1501+107 | 99.23 MB | 28 Feb 2010 - 23:30 |
Exabot | 1245+9 | 15.87 MB | 28 Feb 2010 - 23:40 |
Speedy Spider | 1225+1 | 23.00 MB | 25 Feb 2010 - 02:26 |
Unknown robot (identified by 'spider') | 807+60 | 16.26 MB | 28 Feb 2010 - 22:30 |
MJ12bot | 714+8 | 23.42 MB | 28 Feb 2010 - 11:24 |
LiveJournal.com | 296 | 11.60 MB | 28 Feb 2010 - 19:36 |
DoCoMo | 284+3 | 1.15 MB | 28 Feb 2010 - 13:33 |
Ask | 229+11 | 80.20 MB | 28 Feb 2010 - 17:01 |
Voila | 203+10 | 12.51 MB | 28 Feb 2010 - 21:38 |
CFNetwork | 198 | 1.51 GB | 28 Feb 2010 - 15:36 |
Python-urllib | 183 | 380.37 MB | 28 Feb 2010 - 21:47 |
Yahoo-MMCrawler | 158+3 | 52.86 MB | 25 Feb 2010 - 14:35 |
Turn It In | 108 | 22.58 MB | 01 Feb 2010 - 02:59 |
Alexa (IA Archiver) | 96+10 | 52.65 MB | 28 Feb 2010 - 20:02 |
larbin | 97+8 | 639.63 KB | 26 Feb 2010 - 13:23 |
Unknown robot (identified by hit on 'robots.txt') | 0+101 | 31.13 KB | 28 Feb 2010 - 23:01 |
Web Core / Roots | 73 | 100.83 MB | 28 Feb 2010 - 22:13 |
Jakarta commons-httpclient | 72 | 26.25 MB | 27 Feb 2010 - 22:22 |
ichiro | 48 | 101.13 KB | 04 Feb 2010 - 10:59 |
HTTrack off-line browser | 45 | 133.02 MB | 06 Feb 2010 - 10:20 |
legs | 24+19 | 157.35 KB | 28 Feb 2010 - 03:34 |
Nutch | 29+4 | 767.45 KB | 28 Feb 2010 - 22:09 |
Custo | 28+2 | 10.61 MB | 28 Feb 2010 - 16:30 |
Microsoft URL Control | 25 | 2.35 MB | 25 Feb 2010 - 20:37 |
GigaBot | 19+3 | 97.76 KB | 27 Feb 2010 - 22:53 |
Yahoo! Slurp China | 14+5 | 56.54 KB | 28 Feb 2010 - 23:43 |
Netcraft | 17 | 91.59 KB | 17 Feb 2010 - 23:56 |
WordPress | 12 | 57.37 KB | 05 Feb 2010 - 02:31 |
yacy | 10+1 | 224.72 KB | 27 Feb 2010 - 10:18 |
Findlinks | 9 | 49.38 KB | 26 Feb 2010 - 20:28 |
BSpider | 5+4 | 4.27 MB | 28 Feb 2010 - 15:32 |
UP.Browser | 7 | 4.69 MB | 21 Feb 2010 - 19:05 |
TencentTraveler | 6 | 1.09 MB | 27 Feb 2010 - 18:51 |
Heritrix | 5 | 4.33 MB | 09 Feb 2010 - 17:10 |
MSIECrawler | 4+1 | 115.11 KB | 28 Feb 2010 - 16:51 |
psbot | 4 | 8.11 KB | 10 Feb 2010 - 07:07 |
Powermarks | 4 | 143.05 KB | 27 Feb 2010 - 06:23 |
The web archive (IA Archiver) | 0+4 | 1.29 KB | 28 Feb 2010 - 17:36 |
SurveyBot | 2+1 | 22.77 KB | 27 Feb 2010 - 02:34 |
Motor | 2 | 7.77 MB | 24 Feb 2010 - 17:55 |
lwp-request | 2 | 2.44 KB | 26 Feb 2010 - 19:43 |
Fish search | 2 | 703.71 KB | 24 Feb 2010 - 23:40 |
TITAN | 2 | 1.04 KB | 24 Feb 2010 - 14:01 |
Scooter | 2 | 3.03 MB | 26 Feb 2010 - 14:23 |
mnoGoSearch search engine software | 2 | 11.22 KB | 22 Feb 2010 - 20:40 |
VSE | 2 | 11.56 MB | 11 Feb 2010 - 14:29 |
Susie | 1 | 2.13 KB | 27 Feb 2010 - 08:07 |
Cursor | 1 | 11.22 KB | 10 Feb 2010 - 21:39 |
SpiderMan | 1 | 2.15 KB | 03 Feb 2010 - 06:22 |
Robozilla | 1 | 2.15 KB | 16 Feb 2010 - 08:36 |
Fluid Dynamics Search Engine robot | 1 | 245.91 KB | 15 Feb 2010 - 04:52 |
Sven | 1 | 23.19 KB | 16 Feb 2010 - 07:28 |
WallPaper (alias crawlpaper) | 1 | 8.42 MB | 04 Feb 2010 - 10:02 |
Web Downloader | 1 | 11.22 KB | 20 Feb 2010 - 18:17 |
W3C Link Checker | 1 | 283 Bytes | 12 Feb 2010 - 01:58 |
Xenu Link Sleuth | 1 | 162 Bytes | 25 Feb 2010 - 13:48 |
Lycos | 1 | 559 Bytes | 23 Feb 2010 - 18:20 |