87 different robots | Hits | Bandwidth | Last visit |
Load Balancing Server | 459423 | 907.38 MB | 30 Sep 2011 - 23:56 |
Googlebot | 104330+319 | 6.50 GB | 30 Sep 2011 - 23:55 |
MSNBot | 83336+67 | 810.02 MB | 30 Sep 2011 - 23:36 |
Yahoo Slurp | 60259+368 | 6.28 GB | 30 Sep 2011 - 23:55 |
Yandex bot | 30625+219 | 1.40 GB | 30 Sep 2011 - 23:04 |
Nagios | 24200 | 74.17 MB | 30 Sep 2011 - 23:49 |
Unknown robot (identified by 'bot/' or 'bot-') | 18868+952 | 922.67 MB | 30 Sep 2011 - 23:55 |
Unknown robot (identified by 'crawl') | 9482+7209 | 53.75 MB | 30 Sep 2011 - 23:53 |
Unknown robot (identified by 'robot') | 14587+107 | 134.80 MB | 30 Sep 2011 - 21:39 |
BaiDuSpider | 11847+304 | 283.92 MB | 30 Sep 2011 - 23:54 |
WebVac | 7314+2 | 36.82 MB | 10 Sep 2011 - 08:51 |
Unknown robot (identified by 'spider') | 4685+398 | 119.36 MB | 30 Sep 2011 - 23:24 |
MJ12bot | 3485+292 | 56.98 MB | 30 Sep 2011 - 21:32 |
Exabot | 3359+44 | 32.13 MB | 30 Sep 2011 - 23:24 |
Feedfetcher-Google | 2978 | 72.49 MB | 30 Sep 2011 - 23:55 |
MSNBot-media | 1840+825 | 159.14 MB | 30 Sep 2011 - 23:20 |
Voila | 2437+104 | 149.58 MB | 30 Sep 2011 - 23:45 |
Ocelli | 2533+4 | 255.85 MB | 23 Sep 2011 - 04:52 |
Speedy Spider | 1739+235 | 27.35 MB | 30 Sep 2011 - 23:40 |
Python-urllib | 1875+28 | 1.85 GB | 30 Sep 2011 - 21:13 |
Java (Often spam bot) | 1272+29 | 249.32 MB | 30 Sep 2011 - 20:59 |
Unknown robot (identified by hit on 'robots.txt') | 0+1238 | 499.01 KB | 30 Sep 2011 - 21:23 |
Heritrix | 1208+16 | 954.73 MB | 30 Sep 2011 - 02:41 |
WordPress | 958 | 31.78 MB | 30 Sep 2011 - 23:25 |
legs | 582+245 | 32.16 MB | 30 Sep 2011 - 13:52 |
psbot | 716+70 | 10.12 MB | 30 Sep 2011 - 15:36 |
Alexa (IA Archiver) | 679+103 | 46.61 MB | 30 Sep 2011 - 14:31 |
Vagabondo | 687+7 | 5.18 MB | 23 Sep 2011 - 09:30 |
CFNetwork | 543 | 655.43 MB | 30 Sep 2011 - 23:26 |
MagpieRSS | 338+42 | 1.25 MB | 30 Sep 2011 - 20:30 |
Web Core / Roots | 377 | 357.04 MB | 30 Sep 2011 - 19:55 |
UP.Browser | 339 | 112.38 MB | 30 Sep 2011 - 10:21 |
Yahoo! Slurp China | 210+127 | 6.84 MB | 30 Sep 2011 - 19:21 |
DoCoMo | 276+49 | 14.55 MB | 30 Sep 2011 - 10:26 |
Nutch | 212+65 | 7.41 MB | 30 Sep 2011 - 19:29 |
Custo | 199+38 | 12.43 MB | 30 Sep 2011 - 16:54 |
MLBot | 163+42 | 3.69 MB | 30 Sep 2011 - 19:52 |
BSpider | 143+56 | 1008.23 KB | 30 Sep 2011 - 23:40 |
Motor | 150 | 15.11 MB | 30 Sep 2011 - 23:54 |
GigaBot | 86+55 | 259.39 KB | 30 Sep 2011 - 03:54 |
FAST Enterprise Crawler | 107+14 | 2.99 MB | 28 Sep 2011 - 20:53 |
Jakarta commons-httpclient | 100 | 13.67 MB | 30 Sep 2011 - 19:38 |
MojeekBot | 38+49 | 644.75 KB | 29 Sep 2011 - 05:25 |
archive.org bot | 65+16 | 4.87 MB | 30 Sep 2011 - 16:59 |
WallPaper (alias crawlpaper) | 74 | 7.42 MB | 30 Sep 2011 - 17:26 |
Emacs-w3 Search Engine | 69 | 724.95 KB | 23 Sep 2011 - 11:30 |
Powermarks | 67 | 977.08 KB | 30 Sep 2011 - 23:52 |
TencentTraveler | 57 | 6.69 MB | 29 Sep 2011 - 18:34 |
ichiro | 39+15 | 312.86 KB | 28 Sep 2011 - 14:30 |
bender focused_crawler | 44+5 | 1.03 MB | 30 Sep 2011 - 22:17 |
VORTEX | 45 | 6.86 MB | 28 Sep 2011 - 09:35 |
SeznamBot | 33+8 | 1.79 MB | 30 Sep 2011 - 11:01 |
Ask | 13+26 | 311.06 KB | 21 Sep 2011 - 15:45 |
Findlinks | 7+24 | 48.99 KB | 30 Sep 2011 - 13:47 |
Xenu Link Sleuth | 31 | 141.86 KB | 30 Sep 2011 - 12:31 |
HTTrack off-line browser | 17+12 | 11.53 MB | 29 Sep 2011 - 21:22 |
Netcraft | 24 | 89.62 KB | 30 Sep 2011 - 19:09 |
larbin | 13+11 | 67.86 KB | 15 Sep 2011 - 15:33 |
MSIECrawler | 8+11 | 442.14 KB | 28 Sep 2011 - 23:29 |
WebCollage | 17 | 497.71 KB | 27 Sep 2011 - 09:20 |
Google AdSense | 15 | 388.57 KB | 29 Sep 2011 - 16:09 |
yacy | 7+7 | 4.70 MB | 25 Sep 2011 - 08:24 |
VSE | 13 | 1.80 MB | 27 Sep 2011 - 14:00 |
SurveyBot | 7+1 | 20.60 KB | 23 Sep 2011 - 01:24 |
W3C Validator | 8 | 10.95 MB | 26 Sep 2011 - 09:56 |
LinkChecker | 4+4 | 10.97 KB | 27 Sep 2011 - 16:03 |
Y!J Yahoo Japan | 3+4 | 647.25 KB | 28 Sep 2011 - 04:39 |
SuperBot | 6 | 63.73 MB | 05 Sep 2011 - 11:38 |
NetMechanic | 3+3 | 1.90 KB | 26 Sep 2011 - 02:13 |
Microsoft URL Control | 4 | 2.13 MB | 16 Sep 2011 - 06:59 |
BBot | 4 | 2.50 MB | 26 Sep 2011 - 14:08 |
Webdup | 3 | 491.80 KB | 24 Sep 2011 - 22:19 |
Fish search | 3 | 1.84 MB | 20 Sep 2011 - 04:52 |
Web Downloader | 3 | 1.63 MB | 30 Sep 2011 - 16:44 |
EasyDL | 3 | 213.74 KB | 07 Sep 2011 - 01:49 |
Voyager | 3 | 29.52 KB | 30 Sep 2011 - 21:23 |
Perman surfer | 0+3 | 1.13 KB | 24 Sep 2011 - 07:02 |
Feedburner | 2 | 420 Bytes | 14 Sep 2011 - 01:41 |
MSRBOT | 1+1 | 4.25 KB | 09 Sep 2011 - 13:56 |
Turn It In | 0+1 | 386 Bytes | 14 Sep 2011 - 22:16 |
ChristCrawler.com | 1 | 10.66 KB | 21 Sep 2011 - 20:57 |
Cursor | 1 | 1.09 KB | 17 Sep 2011 - 10:38 |
WWWC Ver 0.2.5 | 1 | 1.00 MB | 23 Sep 2011 - 04:39 |
NG 1.x (Exalead) | 1 | 215.37 KB | 22 Sep 2011 - 09:21 |
Boris | 1 | 67.49 KB | 22 Sep 2011 - 12:39 |
Combine System | 0+1 | 386 Bytes | 08 Sep 2011 - 21:40 |
arks | 1 | 1.40 MB | 27 Sep 2011 - 13:44 |