89 different robots | Hits | Bandwidth | Last visit |
Googlebot | 151031+61 | 8.78 GB | 30 Jun 2011 - 22:31 |
Load Balancing Server | 86517 | 258.82 MB | 30 Jun 2011 - 22:32 |
Yahoo Slurp | 68874+171 | 12.27 GB | 30 Jun 2011 - 22:32 |
Yandex bot | 36763+103 | 1.34 GB | 30 Jun 2011 - 22:31 |
Unknown robot (identified by 'spider') | 20008+155 | 192.79 MB | 30 Jun 2011 - 21:50 |
Unknown robot (identified by 'bot/' or 'bot-') | 19409+210 | 955.97 MB | 30 Jun 2011 - 22:04 |
Nagios | 18411 | 27.81 MB | 30 Jun 2011 - 22:30 |
Unknown robot (identified by 'crawl') | 11315+5643 | 144.31 MB | 30 Jun 2011 - 22:18 |
Unknown robot (identified by 'robot') | 14699+70 | 245.61 MB | 30 Jun 2011 - 21:53 |
WebVac | 5834+1 | 32.12 MB | 07 Jun 2011 - 05:26 |
MSNBot-media | 4262+1331 | 415.92 MB | 30 Jun 2011 - 22:10 |
FAST Enterprise Crawler | 5032+14 | 19.73 MB | 28 Jun 2011 - 00:44 |
MJ12bot | 2877+182 | 46.96 MB | 30 Jun 2011 - 18:28 |
Voila | 2828+74 | 153.01 MB | 30 Jun 2011 - 19:11 |
Speedy Spider | 2336+250 | 31.59 MB | 30 Jun 2011 - 20:06 |
Exabot | 2237+26 | 15.86 MB | 30 Jun 2011 - 22:29 |
Feedfetcher-Google | 2046 | 103.04 MB | 30 Jun 2011 - 22:15 |
Java (Often spam bot) | 1354+3 | 460.92 MB | 30 Jun 2011 - 20:33 |
BaiDuSpider | 1196+25 | 83.65 MB | 30 Jun 2011 - 22:32 |
WordPress | 952 | 6.94 MB | 30 Jun 2011 - 22:15 |
bender focused_crawler | 812+97 | 6.05 MB | 30 Jun 2011 - 19:36 |
Nutch | 670+120 | 212.88 MB | 30 Jun 2011 - 20:32 |
CFNetwork | 675 | 220.55 MB | 30 Jun 2011 - 20:27 |
UP.Browser | 631 | 172.04 MB | 30 Jun 2011 - 20:52 |
Unknown robot (identified by hit on 'robots.txt') | 0+598 | 259.40 KB | 30 Jun 2011 - 20:37 |
legs | 271+212 | 19.90 MB | 30 Jun 2011 - 21:42 |
Alexa (IA Archiver) | 154+321 | 7.16 MB | 30 Jun 2011 - 21:37 |
psbot | 410+42 | 3.35 MB | 29 Jun 2011 - 21:25 |
BSpider | 415+27 | 3.87 MB | 30 Jun 2011 - 22:00 |
TencentTraveler | 405 | 132.45 MB | 30 Jun 2011 - 20:20 |
Custo | 315+86 | 16.45 MB | 30 Jun 2011 - 07:11 |
Powermarks | 345 | 477.85 KB | 30 Jun 2011 - 19:34 |
Motor | 342 | 25.76 MB | 30 Jun 2011 - 19:10 |
Web Core / Roots | 324 | 382.23 MB | 30 Jun 2011 - 21:55 |
GigaBot | 187+102 | 495.76 KB | 29 Jun 2011 - 13:41 |
DoCoMo | 263+22 | 6.91 MB | 30 Jun 2011 - 02:48 |
Yahoo! Slurp China | 218+25 | 10.03 MB | 30 Jun 2011 - 14:50 |
MLBot | 183+25 | 2.82 MB | 29 Jun 2011 - 23:11 |
Heritrix | 196+6 | 79.54 MB | 18 Jun 2011 - 09:52 |
Python-urllib | 189+2 | 243.27 MB | 30 Jun 2011 - 20:22 |
MSNBot | 144+47 | 1.04 MB | 30 Jun 2011 - 13:49 |
Ask | 104+29 | 8.20 MB | 30 Jun 2011 - 18:56 |
Jakarta commons-httpclient | 99 | 13.80 MB | 30 Jun 2011 - 13:52 |
MagpieRSS | 53+14 | 5.80 KB | 30 Jun 2011 - 08:02 |
WallPaper (alias crawlpaper) | 64 | 10.75 MB | 27 Jun 2011 - 18:45 |
VORTEX | 54 | 8.31 MB | 30 Jun 2011 - 19:00 |
larbin | 30+21 | 4.92 MB | 30 Jun 2011 - 21:49 |
archive.org bot | 47+2 | 5.28 MB | 22 Jun 2011 - 23:45 |
Findlinks | 15+17 | 180.26 KB | 26 Jun 2011 - 17:41 |
HTTrack off-line browser | 26+2 | 26.04 MB | 30 Jun 2011 - 16:26 |
VSE | 22 | 6.77 MB | 29 Jun 2011 - 13:46 |
Google AdSense | 18 | 140.12 KB | 30 Jun 2011 - 03:31 |
HTMLParser | 17 | 241.89 KB | 28 Jun 2011 - 08:35 |
WebCollage | 14 | 244.16 KB | 30 Jun 2011 - 09:03 |
JCrawler | 11+3 | 65.44 KB | 26 Jun 2011 - 22:49 |
NG 1.x (Exalead) | 14 | 3.15 MB | 16 Jun 2011 - 06:00 |
Xenu Link Sleuth | 13 | 3.75 KB | 30 Jun 2011 - 12:22 |
MSIECrawler | 8+5 | 42.24 KB | 29 Jun 2011 - 03:07 |
gammaSpider, FocusedCrawler | 12 | 1.21 MB | 14 Jun 2011 - 04:15 |
Voyager | 10 | 689.53 KB | 29 Jun 2011 - 20:34 |
SurveyBot | 9 | 41.07 KB | 26 Jun 2011 - 18:39 |
Internet Shinchakubin | 9 | 343.15 KB | 16 Jun 2011 - 13:11 |
yacy | 3+5 | 1.58 MB | 30 Jun 2011 - 17:34 |
Netcraft | 8 | 20.64 KB | 30 Jun 2011 - 08:22 |
Y!J Yahoo Japan | 7 | 15.68 KB | 29 Jun 2011 - 15:14 |
Boris | 6 | 353.88 KB | 03 Jun 2011 - 12:53 |
EasyDL | 5 | 236.03 KB | 28 Jun 2011 - 20:51 |
LinkChecker | 3+2 | 10.87 KB | 30 Jun 2011 - 07:20 |
BBot | 4 | 21.44 MB | 18 Jun 2011 - 03:41 |
NetMechanic | 2+2 | 1.27 KB | 27 Jun 2011 - 02:14 |
TITAN | 4 | 249.27 KB | 23 Jun 2011 - 22:49 |
Pioneer | 3 | 175.40 KB | 24 Jun 2011 - 11:33 |
Web Downloader | 3 | 4.68 MB | 30 Jun 2011 - 00:35 |
Microsoft URL Control | 2 | 34.04 KB | 24 Jun 2011 - 12:14 |
W3C Validator | 2 | 3.47 KB | 25 Jun 2011 - 11:50 |
Susie | 2 | 1.57 MB | 26 Jun 2011 - 05:44 |
ichiro | 1+1 | 2.19 KB | 28 Jun 2011 - 14:42 |
The web archive (IA Archiver) | 0+2 | 772 Bytes | 10 Jun 2011 - 13:56 |
Z-Add Link Checker | 1 | 302 Bytes | 25 Jun 2011 - 22:26 |
FavOrg | 1 | 3.63 KB | 23 Jun 2011 - 02:57 |
InternetSeer | 1 | 3.59 KB | 06 Jun 2011 - 19:40 |
StackRambler | 0+1 | 386 Bytes | 13 Jun 2011 - 04:08 |
Fish search | 1 | 37.93 KB | 11 Jun 2011 - 02:06 |
The World Wide Web Worm | 1 | 67.35 KB | 06 Jun 2011 - 17:36 |
Sunrise | 1 | 1.56 MB | 01 Jun 2011 - 09:50 |
UCSD Crawl | 1 | 100.46 KB | 30 Jun 2011 - 11:48 |
W3C Link Checker | 1 | 3.04 KB | 27 Jun 2011 - 09:32 |
Argus | 1 | 2.57 KB | 16 Jun 2011 - 16:07 |
lwp-trivial | 0+1 | 386 Bytes | 08 Jun 2011 - 10:23 |