92 different robots | Hits | Bandwidth | Last visit |
Googlebot | 1388120+73 | 448.65 GB | 28 Feb 2010 - 23:59 |
Load Balancing Server | 552238 | 2.65 GB | 28 Feb 2010 - 23:59 |
MSNBot | 513773+1586 | 23.90 GB | 28 Feb 2010 - 23:59 |
Yahoo Slurp | 148599+194 | 105.73 GB | 28 Feb 2010 - 23:59 |
Unknown robot (identified by 'robot') | 134500+219 | 1.99 GB | 28 Feb 2010 - 23:58 |
Unknown robot (identified by 'crawl') | 36063+7825 | 623.18 MB | 28 Feb 2010 - 23:49 |
MLBot | 43478+47 | 334.16 MB | 28 Feb 2010 - 22:56 |
Yandex bot | 35643+135 | 1.08 GB | 28 Feb 2010 - 23:46 |
MSNBot-media | 27725+7285 | 4.05 GB | 28 Feb 2010 - 23:58 |
Nagios | 23863 | 125.83 MB | 28 Feb 2010 - 23:57 |
Java (Often spam bot) | 15544+7 | 1.19 GB | 28 Feb 2010 - 22:56 |
Ocelli | 12860+1 | 715.40 MB | 17 Feb 2010 - 07:05 |
Yahoo-MMCrawler | 12515+126 | 2.78 GB | 28 Feb 2010 - 16:20 |
Unknown robot (identified by 'bot/' or 'bot-') | 6302+1576 | 216.39 MB | 28 Feb 2010 - 23:30 |
Unknown robot (identified by 'spider') | 5296+1132 | 76.61 MB | 28 Feb 2010 - 23:11 |
Voila | 5450+91 | 84.45 MB | 28 Feb 2010 - 23:56 |
WebVac | 5207+1 | 21.53 MB | 06 Feb 2010 - 05:38 |
Speedy Spider | 3576+260 | 49.12 MB | 25 Feb 2010 - 11:45 |
Exabot | 3613+30 | 23.91 MB | 28 Feb 2010 - 23:51 |
CFNetwork | 3232 | 1.98 GB | 28 Feb 2010 - 23:52 |
BaiDuSpider | 3061+133 | 111.41 MB | 28 Feb 2010 - 23:26 |
Ask | 2101+115 | 234.47 MB | 28 Feb 2010 - 23:31 |
Unknown robot (identified by hit on 'robots.txt') | 0+1301 | 485.63 KB | 28 Feb 2010 - 23:07 |
UP.Browser | 1252 | 451.77 MB | 28 Feb 2010 - 23:36 |
MJ12bot | 1035+20 | 26.05 MB | 28 Feb 2010 - 11:24 |
Nutch | 807+39 | 7.47 MB | 28 Feb 2010 - 22:47 |
Alexa (IA Archiver) | 454+85 | 73.23 MB | 28 Feb 2010 - 23:30 |
Python-urllib | 519+19 | 488.43 MB | 28 Feb 2010 - 21:47 |
Web Core / Roots | 495 | 517.95 MB | 28 Feb 2010 - 22:13 |
Jakarta commons-httpclient | 471+13 | 138.84 MB | 28 Feb 2010 - 21:27 |
Custo | 373+101 | 50.18 MB | 28 Feb 2010 - 19:13 |
GigaBot | 356+71 | 2.17 MB | 28 Feb 2010 - 18:10 |
Powermarks | 379 | 317.02 KB | 28 Feb 2010 - 23:09 |
legs | 147+221 | 9.42 MB | 28 Feb 2010 - 17:55 |
DoCoMo | 304+42 | 2.14 MB | 28 Feb 2010 - 15:45 |
InfoBot | 310+5 | 7.07 MB | 27 Feb 2010 - 01:27 |
LiveJournal.com | 296 | 11.60 MB | 28 Feb 2010 - 19:36 |
Yahoo! Slurp China | 257+26 | 7.16 MB | 28 Feb 2010 - 23:43 |
TencentTraveler | 260 | 25.77 MB | 28 Feb 2010 - 08:46 |
WordPress | 249 | 1.93 MB | 28 Feb 2010 - 16:15 |
Feedfetcher-Google | 239 | 59.49 MB | 28 Feb 2010 - 15:55 |
SpiderMan | 217+1 | 1.58 MB | 03 Feb 2010 - 11:48 |
Turn It In | 216+1 | 24.57 MB | 03 Feb 2010 - 01:26 |
psbot | 190+15 | 513.95 KB | 21 Feb 2010 - 05:42 |
VSE | 197 | 35.44 MB | 28 Feb 2010 - 18:24 |
yacy | 68+83 | 1.09 MB | 27 Feb 2010 - 10:24 |
larbin | 119+32 | 894.10 KB | 26 Feb 2010 - 14:47 |
The web archive (IA Archiver) | 0+149 | 55.95 KB | 28 Feb 2010 - 17:36 |
lwp-request | 131 | 518.23 KB | 27 Feb 2010 - 23:27 |
HTTrack off-line browser | 66+1 | 140.76 MB | 28 Feb 2010 - 14:37 |
Robozilla | 66 | 303.86 KB | 16 Feb 2010 - 09:01 |
WebCollage | 53 | 1.54 MB | 20 Feb 2010 - 05:48 |
ichiro | 49+1 | 105.09 KB | 04 Feb 2010 - 18:28 |
MSIECrawler | 25+25 | 2.25 MB | 28 Feb 2010 - 16:51 |
Google AdSense | 43 | 1.94 MB | 28 Feb 2010 - 23:03 |
Microsoft URL Control | 35 | 3.02 MB | 25 Feb 2010 - 20:37 |
Xenu Link Sleuth | 35 | 9.61 KB | 26 Feb 2010 - 12:58 |
Heritrix | 22+11 | 6.39 MB | 27 Feb 2010 - 01:15 |
LinkWalker | 16+16 | 106.55 KB | 25 Feb 2010 - 03:46 |
BSpider | 5+26 | 4.28 MB | 28 Feb 2010 - 15:32 |
Netcraft | 29 | 124.27 KB | 28 Feb 2010 - 17:14 |
Lycos | 21+4 | 3.49 MB | 23 Feb 2010 - 21:41 |
StackRambler | 7+16 | 54.97 KB | 27 Feb 2010 - 21:47 |
W3C Link Checker | 13+6 | 6.39 KB | 24 Feb 2010 - 01:48 |
Findlinks | 16+1 | 105.16 KB | 28 Feb 2010 - 04:20 |
Fish search | 17 | 944.07 KB | 25 Feb 2010 - 08:16 |
SurveyBot | 14+1 | 54.27 KB | 28 Feb 2010 - 04:36 |
gammaSpider, FocusedCrawler | 12 | 218.72 KB | 10 Feb 2010 - 10:00 |
Motor | 12 | 11.18 MB | 26 Feb 2010 - 03:51 |
BBot | 12 | 25.82 MB | 17 Feb 2010 - 05:29 |
lwp-trivial | 10 | 348.17 KB | 28 Feb 2010 - 17:04 |
WallPaper (alias crawlpaper) | 9 | 8.67 MB | 21 Feb 2010 - 04:16 |
DNAbot | 2+5 | 25.07 KB | 18 Feb 2010 - 04:42 |
Cursor | 7 | 259.06 KB | 27 Feb 2010 - 18:31 |
Vagabondo | 3+3 | 493.38 KB | 20 Feb 2010 - 14:55 |
Girafabot | 0+6 | 2.26 KB | 25 Feb 2010 - 19:26 |
W3C Validator | 5 | 63.08 KB | 22 Feb 2010 - 02:02 |
NetMechanic | 2+2 | 1.27 KB | 13 Feb 2010 - 03:35 |
Susie | 2 | 5.70 KB | 27 Feb 2010 - 08:07 |
JoBo Java Web Robot | 1+1 | 4.27 KB | 22 Feb 2010 - 00:37 |
Fluid Dynamics Search Engine robot | 2 | 255.19 KB | 27 Feb 2010 - 02:31 |
Web Downloader | 2 | 1.57 MB | 25 Feb 2010 - 00:03 |
YahooSeeker Yahoo! Blog crawler | 0+2 | 772 Bytes | 26 Feb 2010 - 00:39 |
Boris | 2 | 103.94 KB | 26 Feb 2010 - 03:17 |
TITAN | 2 | 1.04 KB | 24 Feb 2010 - 14:01 |
Scooter | 2 | 3.03 MB | 26 Feb 2010 - 14:23 |
mnoGoSearch search engine software | 2 | 11.22 KB | 22 Feb 2010 - 20:40 |
FavOrg | 1 | 33.07 KB | 16 Feb 2010 - 15:25 |
Openfind data gatherer | 1 | 4.34 KB | 15 Feb 2010 - 10:47 |
Sven | 1 | 23.19 KB | 16 Feb 2010 - 07:28 |
EasyDL | 1 | 239.65 KB | 23 Feb 2010 - 05:05 |
Voyager | 1 | 286 Bytes | 27 Feb 2010 - 03:39 |