108 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 290699+328 | 9.19 GB | 28 Feb 2009 - 23:59 |
Googlebot | 205971+51 | 6.02 GB | 28 Feb 2009 - 23:59 |
MSNBot | 183391+1012 | 2.35 GB | 28 Feb 2009 - 23:56 |
MSNBot-media | 20504+3160 | 1.42 GB | 28 Feb 2009 - 23:45 |
Nagios | 16516 | 39.75 MB | 28 Feb 2009 - 23:53 |
Unknown robot (identified by 'robot') | 14970+77 | 229.62 MB | 28 Feb 2009 - 23:48 |
Exabot | 14709+17 | 112.22 MB | 27 Feb 2009 - 15:04 |
Unknown robot (identified by 'spider') | 9483+1486 | 119.58 MB | 28 Feb 2009 - 23:10 |
Unknown robot (identified by 'crawl') | 9204+290 | 697.52 MB | 28 Feb 2009 - 21:19 |
psbot | 8527+200 | 462.06 MB | 28 Feb 2009 - 23:46 |
Voila | 6299+37 | 101.99 MB | 28 Feb 2009 - 23:42 |
WebVac | 5620+1 | 26.60 MB | 05 Feb 2009 - 16:01 |
Ask | 4975+143 | 194.22 MB | 28 Feb 2009 - 23:13 |
Yahoo! Slurp China | 4728+122 | 49.61 MB | 28 Feb 2009 - 23:14 |
Unknown robot (identified by hit on 'robots.txt') | 0+4484 | 1.59 MB | 28 Feb 2009 - 23:42 |
Nutch | 2399+118 | 46.04 MB | 28 Feb 2009 - 17:35 |
Jakarta commons-httpclient | 1820+30 | 61.44 MB | 28 Feb 2009 - 23:18 |
BaiDuSpider | 1468+41 | 19.36 MB | 28 Feb 2009 - 23:37 |
Yandex bot | 1458+14 | 26.55 MB | 26 Feb 2009 - 14:12 |
Java (Often spam bot) | 1454+8 | 53.35 MB | 28 Feb 2009 - 23:58 |
Unknown robot (identified by 'bot/' or 'bot-') | 758+87 | 13.53 MB | 28 Feb 2009 - 21:27 |
Speedy Spider | 503+233 | 15.52 MB | 27 Feb 2009 - 03:05 |
MLBot | 691+39 | 6.03 MB | 28 Feb 2009 - 23:04 |
InfoBot | 688+8 | 15.11 MB | 26 Feb 2009 - 09:01 |
Turn It In | 650+2 | 5.23 MB | 28 Feb 2009 - 22:17 |
GigaBot | 475+109 | 10.23 MB | 25 Feb 2009 - 08:21 |
Grub.org | 546+27 | 10.19 MB | 28 Feb 2009 - 23:25 |
Alexa (IA Archiver) | 534+35 | 20.73 MB | 28 Feb 2009 - 16:27 |
Feedfetcher-Google | 552 | 603.52 KB | 28 Feb 2009 - 23:40 |
LiveJournal.com | 538 | 6.07 MB | 28 Feb 2009 - 23:42 |
ConveraCrawler | 452+22 | 7.52 MB | 12 Feb 2009 - 01:44 |
WordPress | 450 | 3.46 MB | 28 Feb 2009 - 21:36 |
The web archive (IA Archiver) | 0+378 | 142.49 KB | 27 Feb 2009 - 17:01 |
WebCollage | 329 | 29.32 MB | 28 Feb 2009 - 23:39 |
Custo | 248+54 | 31.31 MB | 27 Feb 2009 - 11:35 |
Ocelli | 297+2 | 22.75 MB | 26 Feb 2009 - 00:55 |
CFNetwork | 270 | 831.67 MB | 28 Feb 2009 - 16:11 |
TencentTraveler | 248 | 46.76 MB | 28 Feb 2009 - 08:49 |
MagpieRSS | 245 | 79.29 MB | 20 Feb 2009 - 04:54 |
VSE | 237+2 | 13.01 MB | 09 Feb 2009 - 16:33 |
Python-urllib | 213+19 | 6.76 MB | 28 Feb 2009 - 23:20 |
MJ12bot | 218+8 | 15.70 MB | 26 Feb 2009 - 20:43 |
Powermarks | 195 | 2.04 MB | 28 Feb 2009 - 21:01 |
SpiderMan | 171+5 | 12.89 MB | 27 Feb 2009 - 17:07 |
Gaisbot | 137+16 | 2.70 MB | 27 Feb 2009 - 18:16 |
Heritrix | 131+13 | 1.88 MB | 28 Feb 2009 - 01:40 |
DoCoMo | 134+6 | 3.53 MB | 28 Feb 2009 - 23:46 |
MSIECrawler | 103+36 | 16.99 MB | 28 Feb 2009 - 06:14 |
larbin | 61+59 | 2.93 MB | 28 Feb 2009 - 22:49 |
Asterias | 99 | 1.94 MB | 03 Feb 2009 - 00:33 |
Yahoo-MMCrawler | 91+4 | 15.04 MB | 28 Feb 2009 - 16:52 |
Robozilla | 92 | 423.53 KB | 13 Feb 2009 - 22:16 |
NewsGator Online | 89 | 0 | 28 Feb 2009 - 12:03 |
Voyager | 69+10 | 567.08 KB | 26 Feb 2009 - 07:25 |
UP.Browser | 69 | 18.66 MB | 28 Feb 2009 - 12:27 |
lwp-request | 58 | 83.21 KB | 28 Feb 2009 - 21:28 |
BlogPulse ISSpider intelliseek.com | 37+19 | 1.67 MB | 22 Feb 2009 - 22:08 |
yacy | 34+19 | 11.82 MB | 27 Feb 2009 - 15:37 |
LinkWalker | 30+15 | 152.27 KB | 26 Feb 2009 - 05:08 |
Checkbot | 35 | 166.09 KB | 28 Feb 2009 - 03:21 |
Fish search | 34 | 690.88 KB | 27 Feb 2009 - 22:28 |
FAST Enterprise Crawler | 32+2 | 280.84 KB | 17 Feb 2009 - 15:07 |
BSpider | 15+16 | 182.76 KB | 28 Feb 2009 - 21:14 |
Google AdSense | 29 | 887.01 KB | 28 Feb 2009 - 23:08 |
Motor | 27 | 1.04 MB | 27 Feb 2009 - 14:47 |
BBot | 25+1 | 6.06 MB | 28 Feb 2009 - 23:58 |
Microsoft URL Control | 25 | 1.38 MB | 27 Feb 2009 - 06:13 |
StackRambler | 23+2 | 630.94 KB | 23 Feb 2009 - 06:48 |
Vagabondo | 15+9 | 2.00 MB | 25 Feb 2009 - 15:17 |
BlogSearch | 24 | 854.65 KB | 28 Feb 2009 - 17:04 |
Xenu Link Sleuth | 24 | 19.13 KB | 28 Feb 2009 - 17:43 |
HTTrack off-line browser | 18+5 | 2.29 MB | 28 Feb 2009 - 08:40 |
Scooter | 0+20 | 7.54 KB | 28 Feb 2009 - 14:48 |
lmspider | 8+12 | 437.64 KB | 26 Feb 2009 - 10:09 |
Holmes | 10+9 | 5.61 MB | 27 Feb 2009 - 12:50 |
EasyDL | 19 | 1.33 MB | 25 Feb 2009 - 14:07 |
HTMLParser | 17 | 245.58 KB | 13 Feb 2009 - 04:28 |
Snappy | 15 | 138.72 KB | 21 Feb 2009 - 20:12 |
Pioneer | 12 | 96.34 KB | 04 Feb 2009 - 18:26 |
Web Core / Roots | 11 | 5.61 MB | 28 Feb 2009 - 16:23 |
Y!J Yahoo Japan | 10+1 | 591.25 KB | 27 Feb 2009 - 18:46 |
W3C Validator | 10 | 30.34 KB | 23 Feb 2009 - 22:48 |
W3C jigsaw CSS Validator | 9 | 51.13 KB | 23 Feb 2009 - 22:48 |
Cursor | 7 | 238.04 KB | 28 Feb 2009 - 12:57 |
NutchCVS | 7 | 59.77 KB | 05 Feb 2009 - 15:38 |
FavOrg | 6 | 198.54 KB | 22 Feb 2009 - 10:22 |
Netcraft | 6 | 38.04 KB | 26 Feb 2009 - 07:07 |
Walhello appie | 3+3 | 11.91 KB | 28 Feb 2009 - 06:05 |
Girafabot | 0+6 | 2.26 KB | 26 Feb 2009 - 03:05 |
mnoGoSearch search engine software | 5+1 | 144.19 KB | 18 Feb 2009 - 19:02 |
lwp-trivial | 6 | 246.48 KB | 25 Feb 2009 - 21:48 |
IBM Almaden Research Center WebFountain™ | 4+2 | 85.40 KB | 19 Feb 2009 - 16:36 |
Digger | 3+1 | 11.13 KB | 20 Feb 2009 - 20:31 |
Internet Shinchakubin | 3 | 62.44 KB | 21 Feb 2009 - 07:36 |
The World Wide Web Worm | 3 | 380.72 KB | 08 Feb 2009 - 19:20 |
LinkChecker | 2+1 | 17.31 KB | 24 Feb 2009 - 13:50 |
Combine System | 1+2 | 772 Bytes | 08 Feb 2009 - 16:12 |
TITAN | 3 | 443.33 KB | 03 Feb 2009 - 11:25 |
ichiro | 2 | 2.06 KB | 01 Feb 2009 - 17:44 |
Web Downloader | 2 | 25.49 KB | 04 Feb 2009 - 13:13 |
MojeekBot | 1+1 | 19.43 KB | 17 Feb 2009 - 09:47 |
arks | 2 | 2.08 MB | 23 Feb 2009 - 07:08 |
SuperBot | 1 | 77.61 KB | 04 Feb 2009 - 06:29 |
Seekbot | 1 | 9.19 KB | 11 Feb 2009 - 10:09 |
Feedburner | 1 | 341 Bytes | 11 Feb 2009 - 11:07 |
NG 2.x (Exalead) | 0+1 | 386 Bytes | 12 Feb 2009 - 11:38 |
YahooSeeker Yahoo! Blog crawler | 0+1 | 386 Bytes | 11 Feb 2009 - 22:06 |
Sunrise | 1 | 34.82 KB | 13 Feb 2009 - 09:20 |