48 different robots | Hits | Bandwidth | Last visit |
Googlebot | 38113+208 | 257.46 MB | 30 Nov 2012 - 23:59 |
Load Balancing Server | 258954 | 453.29 MB | 30 Nov 2012 - 23:59 |
BaiDuSpider | 8437+19 | 106.29 MB | 30 Nov 2012 - 23:52 |
Unknown robot (identified by 'crawl') | 6034+1645 | 10.62 MB | 30 Nov 2012 - 23:43 |
TencentTraveler | 90 | 38.74 MB | 30 Nov 2012 - 23:39 |
Unknown robot (identified by 'bot/' or 'bot-') | 6874+457 | 73.16 MB | 30 Nov 2012 - 23:34 |
MJ12bot | 72+67 | 2.77 MB | 30 Nov 2012 - 23:10 |
Python-urllib | 666+4 | 199.38 MB | 30 Nov 2012 - 22:57 |
Alexa (IA Archiver) | 4+14 | 35.61 KB | 30 Nov 2012 - 22:31 |
MagpieRSS | 323+18 | 644.32 KB | 30 Nov 2012 - 22:18 |
Yandex bot | 586+188 | 10.13 MB | 30 Nov 2012 - 21:41 |
Unknown robot (identified by hit on 'robots.txt') | 0+504 | 205.86 KB | 30 Nov 2012 - 20:55 |
Y!J Yahoo Japan | 0+2 | 702 Bytes | 30 Nov 2012 - 20:55 |
MSNBot-media | 53+48 | 5.06 MB | 30 Nov 2012 - 20:42 |
Unknown robot (identified by 'robot') | 156+62 | 2.18 MB | 30 Nov 2012 - 18:36 |
Yahoo Slurp | 175+43 | 28.83 MB | 30 Nov 2012 - 18:33 |
Exabot | 20+15 | 141.81 KB | 30 Nov 2012 - 18:22 |
BSpider | 45+8 | 91.85 KB | 30 Nov 2012 - 13:54 |
Netcraft | 16 | 68.64 KB | 30 Nov 2012 - 12:25 |
MSNBot | 855+21 | 2.25 MB | 30 Nov 2012 - 11:53 |
Unknown robot (identified by 'spider') | 188+77 | 4.39 MB | 30 Nov 2012 - 05:56 |
Web Core / Roots | 11 | 3.90 MB | 30 Nov 2012 - 02:37 |
Feedfetcher-Google | 47 | 968.40 KB | 30 Nov 2012 - 00:41 |
CFNetwork | 42 | 78.08 MB | 30 Nov 2012 - 00:00 |
Voila | 11+10 | 743.00 KB | 29 Nov 2012 - 21:11 |
Nutch | 25+5 | 89.18 KB | 29 Nov 2012 - 13:54 |
DoCoMo | 7+25 | 60.89 KB | 29 Nov 2012 - 10:19 |
Xenu Link Sleuth | 8 | 1.84 KB | 28 Nov 2012 - 19:43 |
Turn It In | 0+1 | 351 Bytes | 28 Nov 2012 - 12:15 |
Findlinks | 0+1 | 351 Bytes | 28 Nov 2012 - 06:26 |
Yahoo! Slurp China | 5 | 3.43 MB | 28 Nov 2012 - 01:43 |
Java (Often spam bot) | 19 | 382.04 KB | 26 Nov 2012 - 06:12 |
SurveyBot | 1+3 | 3.02 KB | 26 Nov 2012 - 02:01 |
psbot | 15+3 | 249.33 KB | 25 Nov 2012 - 21:42 |
Fish search | 7 | 3.14 MB | 25 Nov 2012 - 08:40 |
legs | 44+6 | 141.29 KB | 23 Nov 2012 - 17:48 |
SeznamBot | 35+11 | 99.14 KB | 22 Nov 2012 - 07:13 |
Jakarta commons-httpclient | 3 | 787.05 KB | 21 Nov 2012 - 21:02 |
FAST Enterprise Crawler | 30+4 | 280.97 KB | 21 Nov 2012 - 17:22 |
Phantom | 10 | 23.59 KB | 21 Nov 2012 - 16:39 |
NG 1.x (Exalead) | 4 | 133.24 KB | 19 Nov 2012 - 22:47 |
Motor | 1 | 4.34 KB | 18 Nov 2012 - 13:42 |
yacy | 0+3 | 1.14 KB | 16 Nov 2012 - 11:33 |
WallPaper (alias crawlpaper) | 1 | 110.97 KB | 11 Nov 2012 - 07:40 |
Zeus Webster Pro | 2 | 1.68 KB | 09 Nov 2012 - 14:42 |
Vagabondo | 1 | 1.54 KB | 09 Nov 2012 - 12:59 |
InfoSeek Robot 1.0 | 2 | 8.45 KB | 09 Nov 2012 - 07:16 |
archive.org bot | 0+1 | 351 Bytes | 01 Nov 2012 - 21:54 |