91 different robots | Hits | Bandwidth | Last visit |
Googlebot | 907977+50 | 18.98 GB | 31 Oct 2010 - 23:59 |
Load Balancing Server | 85909 | 1.05 GB | 31 Oct 2010 - 23:59 |
Exabot | 3964+23 | 33.22 MB | 31 Oct 2010 - 23:58 |
FAST Enterprise Crawler | 11211+40 | 541.68 MB | 31 Oct 2010 - 23:57 |
Yahoo Slurp | 74314+151 | 8.05 GB | 31 Oct 2010 - 23:57 |
Yandex bot | 45360+95 | 1.54 GB | 31 Oct 2010 - 23:55 |
Motor | 457 | 28.94 MB | 31 Oct 2010 - 23:55 |
Unknown robot (identified by 'bot/' or 'bot-') | 13501+1036 | 863.07 MB | 31 Oct 2010 - 23:53 |
Nagios | 18067 | 47.81 MB | 31 Oct 2010 - 23:52 |
CFNetwork | 1666 | 732.56 MB | 31 Oct 2010 - 23:52 |
Unknown robot (identified by 'spider') | 2122+935 | 15.18 MB | 31 Oct 2010 - 23:51 |
Unknown robot (identified by 'crawl') | 12976+5233 | 133.36 MB | 31 Oct 2010 - 23:50 |
Unknown robot (identified by hit on 'robots.txt') | 0+475 | 211.18 KB | 31 Oct 2010 - 23:49 |
Voila | 3332+80 | 168.97 MB | 31 Oct 2010 - 23:47 |
Web Core / Roots | 265 | 374.31 MB | 31 Oct 2010 - 23:43 |
Java (Often spam bot) | 1903+8 | 232.39 MB | 31 Oct 2010 - 23:43 |
UP.Browser | 1309 | 345.11 MB | 31 Oct 2010 - 23:34 |
HTTrack off-line browser | 1537+6 | 50.85 MB | 31 Oct 2010 - 23:33 |
Nutch | 1458+148 | 27.29 MB | 31 Oct 2010 - 23:31 |
BaiDuSpider | 1357+124 | 363.26 MB | 31 Oct 2010 - 23:25 |
MSNBot-media | 6049+1445 | 1.28 GB | 31 Oct 2010 - 23:25 |
TencentTraveler | 124 | 62.45 MB | 31 Oct 2010 - 23:11 |
Feedfetcher-Google | 731 | 90.33 MB | 31 Oct 2010 - 23:07 |
Ask | 2272+79 | 157.37 MB | 31 Oct 2010 - 23:02 |
MJ12bot | 469+15 | 3.07 MB | 31 Oct 2010 - 23:02 |
Powermarks | 492 | 605.85 KB | 31 Oct 2010 - 23:01 |
DoCoMo | 852+53 | 10.64 MB | 31 Oct 2010 - 22:51 |
MLBot | 1157+35 | 25.87 MB | 31 Oct 2010 - 22:46 |
MSNBot | 13762+1103 | 607.26 MB | 31 Oct 2010 - 22:38 |
W3C Validator | 73 | 625.57 KB | 31 Oct 2010 - 22:32 |
Speedy Spider | 1070+337 | 10.74 MB | 31 Oct 2010 - 22:21 |
Google AdSense | 39 | 810.44 KB | 31 Oct 2010 - 21:58 |
Unknown robot (identified by 'robot') | 206+37 | 3.97 MB | 31 Oct 2010 - 21:54 |
Yahoo! Slurp China | 225+22 | 9.32 MB | 31 Oct 2010 - 21:48 |
Custo | 239+72 | 30.46 MB | 31 Oct 2010 - 21:39 |
WordPress | 303 | 1.62 MB | 31 Oct 2010 - 21:33 |
Python-urllib | 353+1 | 373.52 MB | 31 Oct 2010 - 21:13 |
BSpider | 326+32 | 3.32 MB | 31 Oct 2010 - 20:40 |
Jakarta commons-httpclient | 235+1 | 34.61 MB | 31 Oct 2010 - 20:35 |
Fish search | 1702 | 472.22 MB | 31 Oct 2010 - 18:34 |
The web archive (IA Archiver) | 5+167 | 2.70 MB | 31 Oct 2010 - 17:09 |
MSIECrawler | 55+10 | 1.03 MB | 31 Oct 2010 - 15:21 |
Findlinks | 52+2 | 417.97 KB | 31 Oct 2010 - 15:20 |
GigaBot | 21+39 | 141.88 KB | 31 Oct 2010 - 14:01 |
Alexa (IA Archiver) | 151+50 | 5.11 MB | 31 Oct 2010 - 13:05 |
NG 1.x (Exalead) | 11 | 545.42 KB | 31 Oct 2010 - 10:52 |
Vagabondo | 2+5 | 7.92 KB | 31 Oct 2010 - 09:46 |
VSE | 165 | 7.39 MB | 31 Oct 2010 - 07:09 |
yacy | 38+33 | 4.48 MB | 31 Oct 2010 - 03:04 |
TITAN | 3 | 223.82 KB | 30 Oct 2010 - 23:28 |
WebCollage | 103 | 10.02 MB | 30 Oct 2010 - 23:22 |
NetMechanic | 1+1 | 652 Bytes | 30 Oct 2010 - 23:06 |
SurveyBot | 7 | 46.20 KB | 30 Oct 2010 - 17:38 |
Netcraft | 19 | 66.36 KB | 30 Oct 2010 - 14:18 |
psbot | 174+21 | 8.51 MB | 30 Oct 2010 - 05:50 |
legs | 18+29 | 7.92 MB | 30 Oct 2010 - 05:01 |
Heritrix | 47+8 | 2.10 MB | 30 Oct 2010 - 02:28 |
DNAbot | 16+8 | 160.10 KB | 28 Oct 2010 - 18:15 |
Wild Ferret Web Hopper #1, #2, #3 | 1 | 35.78 KB | 28 Oct 2010 - 13:40 |
Microsoft URL Control | 13 | 1.44 MB | 28 Oct 2010 - 09:59 |
WallPaper (alias crawlpaper) | 15 | 895.99 KB | 28 Oct 2010 - 07:49 |
Susie | 2 | 12.86 KB | 27 Oct 2010 - 17:01 |
WebVac | 5186+1 | 26.89 MB | 27 Oct 2010 - 14:45 |
archive.org bot | 4+2 | 267.95 KB | 27 Oct 2010 - 12:15 |
larbin | 16+10 | 116.12 KB | 27 Oct 2010 - 09:04 |
arianna.libero.it | 1+1 | 49.68 KB | 27 Oct 2010 - 06:24 |
W3C Link Checker | 1+1 | 709 Bytes | 26 Oct 2010 - 17:50 |
EasyDL | 9 | 394.32 KB | 26 Oct 2010 - 12:00 |
Perman surfer | 0+1 | 386 Bytes | 26 Oct 2010 - 05:37 |
BBot | 1 | 21.04 MB | 26 Oct 2010 - 01:31 |
Voyager | 14 | 2.07 MB | 25 Oct 2010 - 23:09 |
Xenu Link Sleuth | 44 | 12.38 KB | 25 Oct 2010 - 17:46 |
StackRambler | 0+9 | 3.39 KB | 25 Oct 2010 - 10:40 |
Combine System | 1+1 | 386 Bytes | 22 Oct 2010 - 20:12 |
YahooSeeker Yahoo! Blog crawler | 1+2 | 204.29 KB | 21 Oct 2010 - 23:41 |
W3C jigsaw CSS Validator | 28 | 37.60 KB | 21 Oct 2010 - 15:25 |
Internet Shinchakubin | 1 | 1.56 KB | 20 Oct 2010 - 19:36 |
Checkbot | 3 | 916 Bytes | 19 Oct 2010 - 04:43 |
Turn It In | 240 | 6.57 MB | 18 Oct 2010 - 08:20 |
Feedburner | 1 | 342 Bytes | 14 Oct 2010 - 23:09 |
HKU WWW Octopus | 7 | 2.09 KB | 13 Oct 2010 - 14:24 |
arks | 5 | 343.72 KB | 11 Oct 2010 - 23:07 |
SpiderMan | 1+2 | 175.72 KB | 10 Oct 2010 - 09:50 |
Crawl libcrawl | 3+3 | 11.91 KB | 09 Oct 2010 - 18:35 |
The World Wide Web Worm | 1 | 67.49 KB | 08 Oct 2010 - 13:25 |
InfoBot | 19 | 864.77 KB | 08 Oct 2010 - 05:50 |
Ocelli | 12266+1 | 1.15 GB | 05 Oct 2010 - 17:10 |
lwp-trivial | 0+1 | 386 Bytes | 04 Oct 2010 - 14:17 |
Shoutcast Directory Service | 2 | 65.97 KB | 04 Oct 2010 - 01:47 |
LinkChecker | 5+2 | 10.09 KB | 03 Oct 2010 - 21:16 |
Digimarc MarcSpider | 2 | 107.22 KB | 03 Oct 2010 - 00:32 |