64 different robots | Hits | Bandwidth | Last visit |
Load Balancing Server | 480814 | 1.71 GB | 31 Jul 2010 - 23:49 |
Googlebot | 89745+312 | 806.62 MB | 31 Jul 2010 - 23:49 |
Unknown robot (identified by 'robot') | 54582+1723 | 129.61 MB | 31 Jul 2010 - 20:36 |
Unknown robot (identified by 'crawl') | 7388+2838 | 34.88 MB | 31 Jul 2010 - 23:44 |
Python-urllib | 8130 | 2.05 GB | 31 Jul 2010 - 23:12 |
Nagios | 7936 | 96.76 MB | 31 Jul 2010 - 23:36 |
Yahoo Slurp | 6917+313 | 968.97 MB | 31 Jul 2010 - 23:47 |
Java (Often spam bot) | 3390+2 | 122.86 MB | 31 Jul 2010 - 22:22 |
MSNBot | 940+1458 | 32.27 MB | 31 Jul 2010 - 23:22 |
Yandex bot | 2202+128 | 30.74 MB | 31 Jul 2010 - 23:49 |
Unknown robot (identified by 'bot/' or 'bot-') | 1424+311 | 45.26 MB | 31 Jul 2010 - 20:10 |
BaiDuSpider | 1213+252 | 222.67 MB | 31 Jul 2010 - 22:43 |
MSNBot-media | 395+284 | 24.48 MB | 31 Jul 2010 - 22:11 |
Speedy Spider | 97+357 | 1.81 MB | 27 Jul 2010 - 08:37 |
Unknown robot (identified by hit on 'robots.txt') | 0+377 | 151.25 KB | 31 Jul 2010 - 20:11 |
Unknown robot (identified by 'spider') | 210+116 | 2.93 MB | 31 Jul 2010 - 21:34 |
FAST Enterprise Crawler | 178+11 | 1.77 MB | 26 Jul 2010 - 17:26 |
Web Core / Roots | 146 | 139.66 MB | 31 Jul 2010 - 02:24 |
Voila | 89+42 | 3.58 MB | 31 Jul 2010 - 11:54 |
BSpider | 84+32 | 767.78 KB | 30 Jul 2010 - 20:36 |
MLBot | 25+75 | 214.44 KB | 31 Jul 2010 - 23:14 |
Ask | 40+44 | 2.15 MB | 29 Jul 2010 - 10:41 |
Yahoo! Slurp China | 20+59 | 112.33 KB | 31 Jul 2010 - 23:22 |
CFNetwork | 78 | 1.03 GB | 31 Jul 2010 - 15:34 |
Exabot | 50+26 | 538.85 KB | 31 Jul 2010 - 16:19 |
MJ12bot | 39+30 | 476.57 KB | 31 Jul 2010 - 05:26 |
Nutch | 31+25 | 268.37 KB | 31 Jul 2010 - 12:55 |
Jakarta commons-httpclient | 38 | 211.66 KB | 17 Jul 2010 - 02:44 |
DoCoMo | 11+25 | 72.73 KB | 31 Jul 2010 - 13:55 |
Custo | 18+17 | 3.02 MB | 30 Jul 2010 - 19:02 |
Turn It In | 26+4 | 237.82 KB | 18 Jul 2010 - 16:04 |
Alexa (IA Archiver) | 8+21 | 839.10 KB | 31 Jul 2010 - 18:27 |
HTTrack off-line browser | 5+17 | 128.61 KB | 31 Jul 2010 - 17:58 |
UP.Browser | 20 | 548.25 KB | 29 Jul 2010 - 17:12 |
Netcraft | 20 | 107.25 KB | 14 Jul 2010 - 05:36 |
Ocelli | 18+1 | 119.15 KB | 18 Jul 2010 - 01:16 |
legs | 7+11 | 119.03 KB | 29 Jul 2010 - 17:26 |
Microsoft URL Control | 13 | 292.59 KB | 23 Jul 2010 - 03:58 |
larbin | 6+7 | 62.26 KB | 12 Jul 2010 - 16:35 |
Findlinks | 10+2 | 52.38 KB | 31 Jul 2010 - 09:40 |
The web archive (IA Archiver) | 0+11 | 3.56 KB | 31 Jul 2010 - 12:04 |
MSIECrawler | 2+7 | 4.26 KB | 30 Jul 2010 - 04:56 |
arks | 8 | 25.35 MB | 29 Jul 2010 - 02:45 |
YahooSeeker Yahoo! Blog crawler | 0+7 | 2.26 KB | 31 Jul 2010 - 01:13 |
VSE | 7 | 3.48 MB | 24 Jul 2010 - 20:25 |
SurveyBot | 3+3 | 34.64 KB | 26 Jul 2010 - 09:47 |
Xenu Link Sleuth | 6 | 1.07 KB | 25 Jul 2010 - 23:27 |
ichiro | 2+4 | 13.41 KB | 17 Jul 2010 - 22:45 |
WordPress | 4 | 14.76 KB | 26 Jul 2010 - 00:30 |
yacy | 0+3 | 936 Bytes | 22 Jul 2010 - 01:42 |
Fish search | 3 | 58.03 KB | 18 Jul 2010 - 12:49 |
Powermarks | 2 | 15.27 KB | 25 Jul 2010 - 16:21 |
SpiderMan | 1+1 | 184.42 KB | 29 Jul 2010 - 07:48 |
WallPaper (alias crawlpaper) | 1 | 1.70 MB | 24 Jul 2010 - 18:00 |
Web Downloader | 1 | 43.05 KB | 09 Jul 2010 - 03:41 |
NG 1.x (Exalead) | 1 | 699.44 MB | 27 Jul 2010 - 15:51 |
LinkChecker | 1 | 17.77 KB | 15 Jul 2010 - 02:09 |
Gaisbot | 0+1 | 369 Bytes | 18 Jul 2010 - 19:45 |
mnoGoSearch search engine software | 1 | 11.22 KB | 12 Jul 2010 - 16:36 |
Cursor | 1 | 2.83 KB | 04 Jul 2010 - 08:18 |
BlogSearch | 0+1 | 331 Bytes | 16 Jul 2010 - 14:26 |
Voyager | 0+1 | 331 Bytes | 19 Jul 2010 - 16:15 |
Heritrix | 0+1 | 331 Bytes | 12 Jul 2010 - 22:08 |
BBot | 1 | 701.55 KB | 10 Jul 2010 - 08:34 |