66 different robots | Hits | Bandwidth | Last visit |
Load Balancing Server | 560494 | 1.93 GB | 30 Jun 2010 - 23:59 |
Googlebot | 80219+176 | 435.70 MB | 30 Jun 2010 - 23:20 |
Unknown robot (identified by 'robot') | 46178+1919 | 64.38 MB | 30 Jun 2010 - 23:59 |
Unknown robot (identified by 'crawl') | 6265+2736 | 33.24 MB | 30 Jun 2010 - 23:41 |
Python-urllib | 8649+1 | 1.60 GB | 30 Jun 2010 - 23:33 |
Yahoo Slurp | 5881+313 | 527.04 MB | 30 Jun 2010 - 23:42 |
Nagios | 3671 | 43.52 MB | 30 Jun 2010 - 23:49 |
Java (Often spam bot) | 3144+2 | 1.91 GB | 30 Jun 2010 - 23:45 |
MSNBot | 1421+1511 | 72.11 MB | 30 Jun 2010 - 23:32 |
Yandex bot | 2766+124 | 18.99 MB | 30 Jun 2010 - 23:41 |
BaiDuSpider | 1202+211 | 20.49 MB | 30 Jun 2010 - 23:23 |
Unknown robot (identified by 'bot/' or 'bot-') | 871+215 | 37.90 MB | 30 Jun 2010 - 23:49 |
MSNBot-media | 269+218 | 24.46 MB | 30 Jun 2010 - 23:28 |
Speedy Spider | 92+338 | 1.74 MB | 26 Jun 2010 - 06:03 |
Unknown robot (identified by hit on 'robots.txt') | 0+324 | 97.57 KB | 30 Jun 2010 - 23:01 |
CFNetwork | 226 | 2.43 GB | 30 Jun 2010 - 21:30 |
Unknown robot (identified by 'spider') | 114+73 | 798.37 KB | 30 Jun 2010 - 20:22 |
FAST Enterprise Crawler | 170+13 | 1.63 MB | 24 Jun 2010 - 17:32 |
MJ12bot | 144+35 | 6.13 MB | 30 Jun 2010 - 23:10 |
Voila | 104+38 | 1.98 MB | 30 Jun 2010 - 12:46 |
Heritrix | 98+5 | 520.54 KB | 30 Jun 2010 - 15:04 |
Exabot | 69+31 | 264.14 KB | 30 Jun 2010 - 23:12 |
Ask | 45+48 | 2.97 MB | 30 Jun 2010 - 11:43 |
archive.org bot | 89+2 | 494.82 KB | 27 Jun 2010 - 21:44 |
MLBot | 13+60 | 128.41 KB | 29 Jun 2010 - 22:42 |
WordPress | 69 | 75.04 MB | 09 Jun 2010 - 02:22 |
Yahoo! Slurp China | 16+48 | 82.63 KB | 30 Jun 2010 - 15:45 |
Web Core / Roots | 61 | 53.20 MB | 30 Jun 2010 - 03:07 |
Custo | 23+17 | 5.96 MB | 30 Jun 2010 - 20:25 |
Nutch | 20+19 | 383.39 KB | 29 Jun 2010 - 10:03 |
DoCoMo | 4+19 | 26.32 KB | 30 Jun 2010 - 02:17 |
Netcraft | 22 | 103.71 KB | 18 Jun 2010 - 15:55 |
Alexa (IA Archiver) | 3+16 | 790.37 KB | 30 Jun 2010 - 23:29 |
Findlinks | 14+2 | 92.97 KB | 28 Jun 2010 - 01:05 |
HTTrack off-line browser | 1+15 | 6.96 KB | 30 Jun 2010 - 11:45 |
BSpider | 2+12 | 8.69 KB | 29 Jun 2010 - 17:03 |
larbin | 5+9 | 53.95 KB | 18 Jun 2010 - 02:19 |
yacy | 2+10 | 7.30 KB | 27 Jun 2010 - 03:48 |
The web archive (IA Archiver) | 0+9 | 2.91 KB | 25 Jun 2010 - 06:45 |
YahooSeeker Yahoo! Blog crawler | 0+9 | 2.91 KB | 11 Jun 2010 - 10:46 |
TencentTraveler | 8 | 1018.48 KB | 25 Jun 2010 - 21:20 |
MSRBOT | 1+7 | 703.77 KB | 16 Jun 2010 - 08:55 |
UP.Browser | 7 | 6.12 MB | 18 Jun 2010 - 20:20 |
legs | 1+6 | 4.16 KB | 29 Jun 2010 - 15:01 |
Xenu Link Sleuth | 6 | 1.42 KB | 29 Jun 2010 - 16:13 |
SurveyBot | 2+3 | 23.42 KB | 24 Jun 2010 - 23:07 |
Fish search | 5 | 733.93 KB | 23 Jun 2010 - 23:27 |
DNAbot | 2+2 | 23.10 KB | 09 Jun 2010 - 10:09 |
WebCollage | 4 | 30.96 KB | 27 Jun 2010 - 11:20 |
ichiro | 2+2 | 12.76 KB | 28 Jun 2010 - 05:54 |
W3C Link Checker | 0+4 | 1.44 KB | 24 Jun 2010 - 14:02 |
MSIECrawler | 0+4 | 1.44 KB | 30 Jun 2010 - 12:29 |
SpiderMan | 1+2 | 2.79 KB | 15 Jun 2010 - 17:38 |
Powermarks | 3 | 33.67 KB | 22 Jun 2010 - 21:13 |
VSE | 3 | 5.68 MB | 27 Jun 2010 - 16:30 |
W3C Validator | 2 | 16.43 KB | 16 Jun 2010 - 19:26 |
BBot | 2 | 145.77 KB | 30 Jun 2010 - 17:32 |
lwp-request | 2 | 606 Bytes | 10 Jun 2010 - 16:54 |
EasyDL | 2 | 4.37 KB | 24 Jun 2010 - 05:53 |
Digger | 1 | 11.22 KB | 13 Jun 2010 - 09:04 |
SuperBot | 1 | 798.25 KB | 02 Jun 2010 - 13:49 |
Motor | 1 | 38.97 KB | 22 Jun 2010 - 16:44 |
StackRambler | 0+1 | 331 Bytes | 20 Jun 2010 - 20:26 |
Jakarta commons-httpclient | 1 | 701.51 KB | 02 Jun 2010 - 10:18 |
Web Downloader | 1 | 11.21 KB | 01 Jun 2010 - 04:00 |
BlogSearch | 0+1 | 331 Bytes | 15 Jun 2010 - 14:25 |