87 different robots | Hits | Bandwidth | Last visit |
Load Balancing Server | 512448 | 998.30 MB | 31 Jul 2011 - 22:43 |
Googlebot | 215532+328 | 7.72 GB | 31 Jul 2011 - 22:43 |
Yahoo Slurp | 68801+381 | 8.05 GB | 31 Jul 2011 - 22:43 |
Yandex bot | 43003+260 | 2.01 GB | 31 Jul 2011 - 22:35 |
Unknown robot (identified by 'robot') | 28115+93 | 226.64 MB | 31 Jul 2011 - 18:33 |
Nagios | 26388 | 81.40 MB | 31 Jul 2011 - 22:38 |
MSNBot | 26065+83 | 244.98 MB | 31 Jul 2011 - 08:37 |
Unknown robot (identified by 'crawl') | 13200+7599 | 85.03 MB | 31 Jul 2011 - 22:42 |
Unknown robot (identified by 'bot/' or 'bot-') | 11106+1296 | 846.69 MB | 31 Jul 2011 - 22:42 |
BaiDuSpider | 10157+158 | 131.97 MB | 31 Jul 2011 - 21:39 |
Unknown robot (identified by 'spider') | 5300+572 | 105.45 MB | 31 Jul 2011 - 22:42 |
WebVac | 4420+1 | 19.84 MB | 08 Jul 2011 - 22:08 |
Java (Often spam bot) | 3424+5 | 226.45 MB | 31 Jul 2011 - 19:23 |
Exabot | 3201+54 | 21.15 MB | 31 Jul 2011 - 22:42 |
MJ12bot | 2939+302 | 56.65 MB | 31 Jul 2011 - 22:15 |
Speedy Spider | 2762+266 | 25.60 MB | 31 Jul 2011 - 18:34 |
Voila | 2519+107 | 154.51 MB | 31 Jul 2011 - 22:28 |
MSNBot-media | 1798+794 | 145.55 MB | 31 Jul 2011 - 21:47 |
bender focused_crawler | 2136+25 | 45.04 MB | 31 Jul 2011 - 11:26 |
psbot | 2050+91 | 1.35 MB | 31 Jul 2011 - 22:16 |
Feedfetcher-Google | 2112 | 78.44 MB | 31 Jul 2011 - 22:20 |
Python-urllib | 1801 | 2.28 GB | 31 Jul 2011 - 22:23 |
WordPress | 1567 | 13.76 MB | 31 Jul 2011 - 22:28 |
Unknown robot (identified by hit on 'robots.txt') | 0+911 | 383.41 KB | 31 Jul 2011 - 22:05 |
legs | 406+224 | 87.47 MB | 29 Jul 2011 - 15:50 |
CFNetwork | 624 | 523.24 MB | 31 Jul 2011 - 20:59 |
UP.Browser | 597 | 190.31 MB | 31 Jul 2011 - 20:47 |
Nutch | 445+106 | 157.54 MB | 31 Jul 2011 - 19:06 |
BSpider | 413+99 | 9.54 MB | 31 Jul 2011 - 17:32 |
Web Core / Roots | 447 | 252.22 MB | 31 Jul 2011 - 19:05 |
DoCoMo | 332+99 | 21.02 MB | 31 Jul 2011 - 16:46 |
FAST Enterprise Crawler | 357+13 | 4.51 MB | 31 Jul 2011 - 07:20 |
GigaBot | 206+110 | 810.38 KB | 30 Jul 2011 - 19:01 |
Alexa (IA Archiver) | 151+142 | 4.88 MB | 31 Jul 2011 - 19:24 |
Custo | 206+80 | 10.35 MB | 31 Jul 2011 - 14:35 |
Yahoo! Slurp China | 192+92 | 10.27 MB | 31 Jul 2011 - 16:09 |
Powermarks | 272 | 346.31 KB | 31 Jul 2011 - 12:24 |
TencentTraveler | 242 | 17.92 MB | 31 Jul 2011 - 17:50 |
Motor | 220 | 17.62 MB | 31 Jul 2011 - 12:51 |
MLBot | 143+55 | 1.31 MB | 31 Jul 2011 - 17:24 |
MagpieRSS | 103+18 | 105.37 KB | 31 Jul 2011 - 22:09 |
WallPaper (alias crawlpaper) | 104 | 12.72 MB | 31 Jul 2011 - 16:09 |
archive.org bot | 96+6 | 7.61 MB | 24 Jul 2011 - 16:36 |
Jakarta commons-httpclient | 73 | 18.30 MB | 31 Jul 2011 - 20:50 |
Ask | 45+15 | 4.46 MB | 27 Jul 2011 - 18:20 |
Ocelli | 52+1 | 237.77 KB | 06 Jul 2011 - 14:07 |
larbin | 22+24 | 267.69 KB | 30 Jul 2011 - 22:44 |
Findlinks | 20+24 | 222.52 KB | 29 Jul 2011 - 23:07 |
HTTrack off-line browser | 31+13 | 34.12 MB | 31 Jul 2011 - 08:33 |
VORTEX | 38 | 4.61 MB | 31 Jul 2011 - 14:07 |
Netcraft | 34 | 90.65 KB | 29 Jul 2011 - 00:33 |
MSIECrawler | 8+22 | 696.14 KB | 31 Jul 2011 - 10:41 |
Google AdSense | 29 | 734.03 KB | 29 Jul 2011 - 03:41 |
SuperBot | 19 | 85.13 KB | 23 Jul 2011 - 12:39 |
yacy | 8+9 | 1.59 MB | 20 Jul 2011 - 22:28 |
Checkbot | 15 | 4.47 KB | 16 Jul 2011 - 12:47 |
Xenu Link Sleuth | 15 | 4.16 KB | 31 Jul 2011 - 18:24 |
SurveyBot | 12+2 | 43.75 KB | 30 Jul 2011 - 15:37 |
WebCollage | 10 | 375.63 KB | 31 Jul 2011 - 21:35 |
VSE | 10 | 1.91 MB | 27 Jul 2011 - 10:58 |
Turn It In | 5+4 | 6.66 KB | 30 Jul 2011 - 22:14 |
Heritrix | 6+3 | 58.40 KB | 21 Jul 2011 - 01:17 |
Boris | 9 | 317.80 KB | 20 Jul 2011 - 08:25 |
NetMechanic | 4+4 | 2.54 KB | 25 Jul 2011 - 02:14 |
Voyager | 7 | 5.00 MB | 31 Jul 2011 - 14:36 |
Microsoft URL Control | 6 | 2.78 MB | 21 Jul 2011 - 02:18 |
Harvest | 2+2 | 127.63 KB | 27 Jul 2011 - 22:38 |
ichiro | 2+2 | 36.72 KB | 22 Jul 2011 - 02:39 |
Fish search | 3 | 1.37 MB | 08 Jul 2011 - 08:27 |
NG 1.x (Exalead) | 3 | 31.23 KB | 26 Jul 2011 - 21:18 |
W3C Link Checker | 1+2 | 1.11 KB | 22 Jul 2011 - 02:11 |
LinkScan | 3 | 11.01 KB | 20 Jul 2011 - 23:43 |
W3C Validator | 2 | 5.61 KB | 19 Jul 2011 - 19:22 |
BBot | 2 | 3.55 MB | 27 Jul 2011 - 10:48 |
Vagabondo | 0+2 | 772 Bytes | 08 Jul 2011 - 21:38 |
Link Valet Online | 2 | 611 Bytes | 20 Jul 2011 - 12:09 |
Zeus Webster Pro | 1 | 3.06 KB | 20 Jul 2011 - 19:52 |
NG 2.x (Exalead) | 1 | 686.32 KB | 29 Jul 2011 - 07:46 |
EasyDL | 1 | 59.16 KB | 03 Jul 2011 - 08:24 |
HTMLParser | 1 | 10.66 KB | 13 Jul 2011 - 01:25 |
LinkChecker | 0+1 | 386 Bytes | 03 Jul 2011 - 12:04 |
TITAN | 1 | 14.49 KB | 10 Jul 2011 - 13:57 |
Steeler | 0+1 | 351 Bytes | 23 Jul 2011 - 02:49 |
mnoGoSearch search engine software | 1 | 4.36 KB | 22 Jul 2011 - 16:45 |
BlogSearch | 0+1 | 351 Bytes | 21 Jul 2011 - 14:27 |
Y!J Yahoo Japan | 0+1 | 386 Bytes | 30 Jul 2011 - 15:20 |
IBM Almaden Research Center WebFountain™ | 0+1 | 351 Bytes | 28 Jul 2011 - 05:33 |