82 different robots | Hits | Bandwidth | Last visit |
Load Balancing Server | 556772 | 1.06 GB | 30 Jun 2012 - 23:55 |
Googlebot | 224170+290 | 8.02 GB | 30 Jun 2012 - 23:55 |
Unknown robot (identified by 'crawl') | 36886+11364 | 88.74 MB | 30 Jun 2012 - 23:48 |
Yandex bot | 40430+329 | 1.01 GB | 30 Jun 2012 - 23:54 |
Unknown robot (identified by 'bot/' or 'bot-') | 29048+1098 | 1.99 GB | 30 Jun 2012 - 23:53 |
Nagios | 28706 | 87.02 MB | 30 Jun 2012 - 23:55 |
BaiDuSpider | 13686+474 | 264.67 MB | 30 Jun 2012 - 23:52 |
FAST Enterprise Crawler | 9106+36 | 98.97 MB | 30 Jun 2012 - 22:56 |
MSNBot-media | 6700+2225 | 614.08 MB | 30 Jun 2012 - 23:50 |
WebVac | 6264+1 | 35.72 MB | 09 Jun 2012 - 10:40 |
Exabot | 5240+50 | 16.82 MB | 30 Jun 2012 - 23:38 |
CFNetwork | 4918 | 663.12 MB | 30 Jun 2012 - 23:46 |
Feedfetcher-Google | 4751 | 77.60 MB | 30 Jun 2012 - 23:46 |
MJ12bot | 2183+361 | 39.91 MB | 30 Jun 2012 - 21:21 |
UniversalFeedParser | 1931 | 0 | 30 Jun 2012 - 23:52 |
Yahoo Slurp | 1702+174 | 81.14 MB | 30 Jun 2012 - 23:51 |
Unknown robot (identified by 'robot') | 1527+168 | 56.35 MB | 30 Jun 2012 - 23:54 |
Python-urllib | 1548+136 | 864.22 MB | 30 Jun 2012 - 22:56 |
Unknown robot (identified by hit on 'robots.txt') | 0+1594 | 639.02 KB | 30 Jun 2012 - 23:36 |
Voila | 1271+99 | 68.63 MB | 30 Jun 2012 - 23:53 |
Unknown robot (identified by 'spider') | 1068+275 | 99.13 MB | 30 Jun 2012 - 22:30 |
WordPress | 1302 | 32.84 MB | 30 Jun 2012 - 23:46 |
Java (Often spam bot) | 1105+25 | 136.86 MB | 30 Jun 2012 - 22:58 |
MSNBot | 894+83 | 20.44 MB | 30 Jun 2012 - 22:47 |
legs | 838+105 | 23.76 MB | 30 Jun 2012 - 14:52 |
Alexa (IA Archiver) | 718+177 | 15.15 MB | 30 Jun 2012 - 15:22 |
MagpieRSS | 787+61 | 972.23 KB | 30 Jun 2012 - 21:51 |
Nutch | 346+206 | 42.15 MB | 30 Jun 2012 - 18:29 |
HTTrack off-line browser | 515+6 | 30.16 MB | 30 Jun 2012 - 12:16 |
Vagabondo | 472+10 | 375.58 KB | 25 Jun 2012 - 12:53 |
Heritrix | 380+18 | 22.68 MB | 30 Jun 2012 - 21:30 |
Jakarta commons-httpclient | 349 | 17.00 MB | 28 Jun 2012 - 16:58 |
MLBot | 151+197 | 2.20 MB | 30 Jun 2012 - 23:44 |
BSpider | 294+47 | 1.51 MB | 30 Jun 2012 - 21:36 |
UP.Browser | 290 | 58.30 MB | 30 Jun 2012 - 22:33 |
DoCoMo | 156+91 | 11.68 MB | 30 Jun 2012 - 23:54 |
Web Core / Roots | 241 | 246.05 MB | 30 Jun 2012 - 16:32 |
NG 1.x (Exalead) | 198 | 7.21 MB | 30 Jun 2012 - 05:19 |
Powermarks | 157 | 1.58 MB | 30 Jun 2012 - 23:27 |
psbot | 116+15 | 15.57 MB | 29 Jun 2012 - 23:36 |
TencentTraveler | 126 | 18.07 MB | 30 Jun 2012 - 19:31 |
archive.org bot | 93+29 | 2.34 MB | 30 Jun 2012 - 20:32 |
bender focused_crawler | 100+5 | 1.08 MB | 17 Jun 2012 - 02:01 |
WallPaper (alias crawlpaper) | 105 | 10.79 MB | 30 Jun 2012 - 07:30 |
Motor | 102 | 1.69 MB | 30 Jun 2012 - 04:56 |
WebFilter | 96 | 715.93 KB | 30 Jun 2012 - 20:59 |
SeznamBot | 34+30 | 6.15 MB | 29 Jun 2012 - 07:55 |
Xenu Link Sleuth | 62 | 43.95 KB | 30 Jun 2012 - 22:47 |
SpiderMan | 50+7 | 202.05 KB | 30 Jun 2012 - 21:31 |
WebCollage | 46 | 3.76 MB | 29 Jun 2012 - 12:24 |
Findlinks | 18+25 | 57.75 KB | 30 Jun 2012 - 10:05 |
Netcraft | 38 | 91.12 KB | 21 Jun 2012 - 17:10 |
Phantom | 35 | 8.70 MB | 30 Jun 2012 - 13:37 |
yacy | 23+10 | 4.85 MB | 26 Jun 2012 - 18:55 |
Yahoo! Slurp China | 27 | 1.39 MB | 30 Jun 2012 - 01:46 |
VORTEX | 21 | 1.33 MB | 30 Jun 2012 - 16:35 |
SurveyBot | 15+2 | 31.07 KB | 26 Jun 2012 - 10:48 |
Google AdSense | 16 | 374.30 KB | 29 Jun 2012 - 09:17 |
VSE | 14 | 3.28 MB | 30 Jun 2012 - 16:20 |
Turn It In | 2+6 | 22.43 KB | 06 Jun 2012 - 17:25 |
JBot Java Web Robot | 7 | 1.02 MB | 29 Jun 2012 - 15:08 |
Emacs-w3 Search Engine | 6 | 27.68 KB | 11 Jun 2012 - 09:44 |
Custo | 4+1 | 206.99 KB | 29 Jun 2012 - 16:51 |
StackRambler | 5 | 156.65 KB | 22 Jun 2012 - 11:09 |
MSIECrawler | 2+3 | 888.60 KB | 25 Jun 2012 - 18:11 |
W3C Validator | 4 | 17.40 KB | 26 Jun 2012 - 05:59 |
InfoSeek Robot 1.0 | 4 | 17.18 KB | 17 Jun 2012 - 14:35 |
HTMLParser | 4 | 12.54 KB | 06 Jun 2012 - 05:43 |
Y!J Yahoo Japan | 1+3 | 5.90 KB | 29 Jun 2012 - 09:08 |
Speedy Spider | 4 | 8.21 MB | 27 Jun 2012 - 09:39 |
W3C jigsaw CSS Validator | 3 | 12.71 KB | 26 Jun 2012 - 05:59 |
TITAN | 3 | 177.35 KB | 23 Jun 2012 - 03:58 |
Netluchs | 1+1 | 5.83 KB | 10 Jun 2012 - 23:58 |
FavOrg | 2 | 37.74 KB | 19 Jun 2012 - 10:26 |
LinkBot | 2 | 7.29 KB | 17 Jun 2012 - 12:43 |
YahooSeeker Yahoo! Blog crawler | 2 | 123.78 KB | 03 Jun 2012 - 03:43 |
fido | 2 | 104.12 KB | 05 Jun 2012 - 00:35 |
Susie | 1 | 2.13 KB | 08 Jun 2012 - 22:33 |
Zeus Webster Pro | 1 | 860 Bytes | 10 Jun 2012 - 23:45 |
Fish search | 1 | 37.39 KB | 22 Jun 2012 - 19:05 |
LinkChecker | 0+1 | 386 Bytes | 28 Jun 2012 - 18:47 |
larbin | 0+1 | 386 Bytes | 25 Jun 2012 - 02:41 |