55 different robots | Hits | Bandwidth | Last visit |
Load Balancing Server | 468542 | 820.40 MB | 30 Jun 2012 - 23:55 |
Googlebot | 65603+237 | 350.65 MB | 30 Jun 2012 - 23:55 |
Unknown robot (identified by 'crawl') | 15324+4048 | 25.79 MB | 30 Jun 2012 - 23:35 |
Nagios | 9154 | 54.06 MB | 30 Jun 2012 - 23:54 |
BaiDuSpider | 5054+389 | 43.96 MB | 30 Jun 2012 - 23:47 |
Unknown robot (identified by 'bot/' or 'bot-') | 2500+729 | 91.90 MB | 30 Jun 2012 - 23:13 |
Yandex bot | 1255+269 | 7.79 MB | 30 Jun 2012 - 23:50 |
Python-urllib | 1214+56 | 752.88 MB | 30 Jun 2012 - 22:41 |
MSNBot | 637+34 | 2.39 MB | 30 Jun 2012 - 12:18 |
Unknown robot (identified by hit on 'robots.txt') | 0+625 | 247.86 KB | 30 Jun 2012 - 23:36 |
MagpieRSS | 473+26 | 947.10 KB | 30 Jun 2012 - 21:51 |
Unknown robot (identified by 'spider') | 405+54 | 37.46 MB | 30 Jun 2012 - 22:30 |
MJ12bot | 176+148 | 9.09 MB | 30 Jun 2012 - 16:29 |
Unknown robot (identified by 'robot') | 195+51 | 12.06 MB | 29 Jun 2012 - 20:30 |
Yahoo Slurp | 120+69 | 15.76 MB | 30 Jun 2012 - 21:45 |
FAST Enterprise Crawler | 140+5 | 809.83 KB | 18 Jun 2012 - 18:56 |
MLBot | 9+126 | 60.47 KB | 30 Jun 2012 - 16:17 |
BSpider | 96+31 | 229.52 KB | 30 Jun 2012 - 16:59 |
MSNBot-media | 78+38 | 2.09 MB | 30 Jun 2012 - 15:42 |
Feedfetcher-Google | 92 | 1.79 MB | 29 Jun 2012 - 07:08 |
Heritrix | 73+3 | 574.31 KB | 16 Jun 2012 - 01:55 |
Exabot | 49+22 | 346.46 KB | 30 Jun 2012 - 10:01 |
Alexa (IA Archiver) | 31+27 | 139.59 KB | 29 Jun 2012 - 18:16 |
legs | 33+15 | 75.92 KB | 30 Jun 2012 - 00:43 |
Java (Often spam bot) | 47 | 1.63 MB | 30 Jun 2012 - 06:01 |
TencentTraveler | 38 | 5.75 MB | 30 Jun 2012 - 18:52 |
Nutch | 14+23 | 452.81 KB | 29 Jun 2012 - 13:17 |
DoCoMo | 8+26 | 82.48 KB | 30 Jun 2012 - 06:14 |
CFNetwork | 33 | 10.68 MB | 30 Jun 2012 - 11:01 |
Voila | 19+14 | 739.08 KB | 30 Jun 2012 - 01:04 |
archive.org bot | 23+9 | 158.24 KB | 29 Jun 2012 - 18:22 |
WordPress | 28 | 89.04 KB | 25 Jun 2012 - 17:52 |
Netcraft | 25 | 57.62 KB | 21 Jun 2012 - 17:10 |
NG 1.x (Exalead) | 16 | 6.67 MB | 30 Jun 2012 - 05:19 |
Phantom | 14 | 76.50 KB | 21 Jun 2012 - 19:03 |
Findlinks | 5+9 | 12.64 KB | 30 Jun 2012 - 09:44 |
HTTrack off-line browser | 12+1 | 1.37 MB | 23 Jun 2012 - 21:10 |
SeznamBot | 6+6 | 1.38 MB | 20 Jun 2012 - 04:21 |
JBot Java Web Robot | 7 | 1.02 MB | 29 Jun 2012 - 15:08 |
UP.Browser | 6 | 1.41 MB | 30 Jun 2012 - 16:20 |
WebCollage | 6 | 53.55 KB | 29 Jun 2012 - 10:03 |
Emacs-w3 Search Engine | 6 | 27.68 KB | 11 Jun 2012 - 09:44 |
Powermarks | 4 | 14.32 KB | 02 Jun 2012 - 06:51 |
SurveyBot | 2+2 | 4.69 KB | 22 Jun 2012 - 01:24 |
yacy | 2+2 | 29.80 KB | 21 Jun 2012 - 05:24 |
Xenu Link Sleuth | 4 | 5.07 KB | 30 Jun 2012 - 08:22 |
Web Core / Roots | 3 | 2.20 MB | 12 Jun 2012 - 10:25 |
HTMLParser | 2 | 6.34 KB | 02 Jun 2012 - 17:15 |
bender focused_crawler | 0+2 | 702 Bytes | 15 Jun 2012 - 02:33 |
Turn It In | 0+2 | 702 Bytes | 06 Jun 2012 - 15:54 |
Vagabondo | 1 | 1.54 KB | 04 Jun 2012 - 09:51 |
Susie | 1 | 2.13 KB | 08 Jun 2012 - 22:33 |
Zeus Webster Pro | 1 | 860 Bytes | 10 Jun 2012 - 23:45 |
Yahoo! Slurp China | 1 | 2.18 KB | 13 Jun 2012 - 10:30 |
MSIECrawler | 0+1 | 389 Bytes | 15 Jun 2012 - 00:51 |