66 different robots | Hits | Bandwidth | Last visit |
Load Balancing Server | 513823 | 2.69 GB | 31 Jan 2010 - 23:59 |
Googlebot | 444431 | 152.08 GB | 31 Jan 2010 - 23:59 |
Yahoo Slurp | 80124 | 43.98 GB | 31 Jan 2010 - 23:59 |
MLBot | 83937 | 618.63 MB | 31 Jan 2010 - 23:59 |
MSNBot | 663706 | 26.95 GB | 31 Jan 2010 - 23:59 |
Turn It In | 387 | 12.35 MB | 31 Jan 2010 - 23:58 |
Unknown robot (identified by 'robot') | 116929 | 4.06 GB | 31 Jan 2010 - 23:58 |
Nagios | 8264 | 97.94 MB | 31 Jan 2010 - 23:56 |
Unknown robot (identified by 'crawl') | 36488 | 1017.86 MB | 31 Jan 2010 - 23:52 |
Ask | 550 | 133.98 MB | 31 Jan 2010 - 23:39 |
Speedy Spider | 875 | 9.27 MB | 31 Jan 2010 - 23:38 |
BaiDuSpider | 2203 | 50.93 MB | 31 Jan 2010 - 23:36 |
LiveJournal.com | 424 | 16.16 MB | 31 Jan 2010 - 23:31 |
Yandex bot | 6396 | 228.75 MB | 31 Jan 2010 - 23:08 |
Unknown robot (identified by 'spider') | 1098 | 63.08 MB | 31 Jan 2010 - 23:01 |
Java (Often spam bot) | 12845 | 1.98 GB | 31 Jan 2010 - 22:37 |
Jakarta commons-httpclient | 58 | 41.95 MB | 31 Jan 2010 - 22:10 |
Exabot | 15515 | 160.66 MB | 31 Jan 2010 - 16:27 |
Custo | 55 | 1.36 GB | 31 Jan 2010 - 16:19 |
Unknown robot (identified by 'bot/' or 'bot-') | 1931 | 238.39 MB | 31 Jan 2010 - 15:45 |
CFNetwork | 119 | 704.65 MB | 31 Jan 2010 - 14:27 |
MSNBot-media | 271 | 17.34 MB | 31 Jan 2010 - 13:53 |
Web Core / Roots | 74 | 105.38 MB | 31 Jan 2010 - 13:23 |
HTTrack off-line browser | 1086 | 139.61 MB | 31 Jan 2010 - 13:14 |
WallPaper (alias crawlpaper) | 1 | 67.01 KB | 31 Jan 2010 - 12:13 |
Python-urllib | 819 | 244.28 MB | 31 Jan 2010 - 12:05 |
Alexa (IA Archiver) | 135 | 42.47 MB | 31 Jan 2010 - 07:17 |
Microsoft URL Control | 27 | 8.80 MB | 31 Jan 2010 - 06:43 |
UP.Browser | 22 | 23.88 MB | 31 Jan 2010 - 04:03 |
Web Downloader | 1 | 11.21 KB | 31 Jan 2010 - 03:26 |
SpiderMan | 24 | 783.47 KB | 31 Jan 2010 - 02:54 |
MJ12bot | 1054 | 29.58 MB | 30 Jan 2010 - 23:39 |
Yahoo! Slurp China | 11 | 58.70 KB | 30 Jan 2010 - 18:49 |
DoCoMo | 2 | 41.45 KB | 30 Jan 2010 - 17:52 |
BSpider | 8 | 6.25 MB | 30 Jan 2010 - 15:34 |
Fish search | 9 | 2.31 MB | 30 Jan 2010 - 11:32 |
MSIECrawler | 7 | 24.60 KB | 30 Jan 2010 - 08:46 |
yacy | 182 | 18.70 MB | 29 Jan 2010 - 16:19 |
larbin | 11 | 184.54 KB | 29 Jan 2010 - 15:15 |
Voila | 186 | 10.39 MB | 29 Jan 2010 - 09:46 |
Nutch | 97 | 7.37 MB | 28 Jan 2010 - 17:32 |
W3C Validator | 2 | 16.93 KB | 28 Jan 2010 - 11:16 |
HTMLParser | 1 | 701.55 KB | 28 Jan 2010 - 04:26 |
Xenu Link Sleuth | 6 | 1.30 KB | 27 Jan 2010 - 23:43 |
Susie | 2 | 4.26 KB | 25 Jan 2010 - 14:23 |
FAST Enterprise Crawler | 10121 | 191.28 MB | 25 Jan 2010 - 00:41 |
Cursor | 1 | 47.13 KB | 24 Jan 2010 - 12:50 |
SurveyBot | 3 | 33.65 KB | 24 Jan 2010 - 11:21 |
Voyager | 41 | 441.99 KB | 23 Jan 2010 - 13:49 |
SuperBot | 14 | 31.50 KB | 23 Jan 2010 - 09:28 |
TencentTraveler | 17 | 7.56 MB | 23 Jan 2010 - 00:07 |
legs | 19 | 1.76 MB | 22 Jan 2010 - 20:53 |
Findlinks | 1 | 9.95 KB | 22 Jan 2010 - 01:17 |
arks | 13 | 38.07 KB | 21 Jan 2010 - 23:55 |
Feedburner | 1 | 351 Bytes | 20 Jan 2010 - 15:03 |
Netcraft | 27 | 93.88 KB | 20 Jan 2010 - 10:18 |
Muncher | 2 | 1.09 KB | 19 Jan 2010 - 22:53 |
ruffle SemanticWeb crawler | 6 | 76.33 KB | 18 Jan 2010 - 15:30 |
Heritrix | 3 | 2.87 MB | 15 Jan 2010 - 19:17 |
psbot | 1 | 0 | 12 Jan 2010 - 12:25 |
Motor | 2 | 1.35 MB | 12 Jan 2010 - 01:52 |
VSE | 2 | 1.85 MB | 10 Jan 2010 - 14:13 |
VORTEX | 2 | 22.41 KB | 10 Jan 2010 - 07:43 |
WordPress | 2 | 640 Bytes | 06 Jan 2010 - 04:47 |
WebCollage | 10 | 504.63 KB | 05 Jan 2010 - 04:40 |
YahooSeeker Yahoo! Blog crawler | 1 | 546.54 KB | 04 Jan 2010 - 14:02 |