105 different robots | Hits | Bandwidth | Last visit |
Load Balancing Server | 1482339 | 12.32 GB | 31 Oct 2009 - 23:59 |
Googlebot | 751064+52 | 101.99 GB | 31 Oct 2009 - 23:59 |
Nagios | 23921 | 125.42 MB | 31 Oct 2009 - 23:59 |
Yahoo Slurp | 120750+291 | 12.18 GB | 31 Oct 2009 - 23:59 |
Unknown robot (identified by 'robot') | 122986+116 | 2.75 GB | 31 Oct 2009 - 23:59 |
MSNBot | 756817+2349 | 16.33 GB | 31 Oct 2009 - 23:59 |
FAST Enterprise Crawler | 60308+30 | 1.58 GB | 31 Oct 2009 - 23:58 |
MLBot | 102712+47 | 1.30 GB | 31 Oct 2009 - 23:50 |
Exabot | 8979+37 | 171.36 MB | 31 Oct 2009 - 23:39 |
Unknown robot (identified by 'crawl') | 179283+3016 | 19.80 GB | 31 Oct 2009 - 23:38 |
GigaBot | 1146+218 | 11.81 MB | 31 Oct 2009 - 23:38 |
Custo | 489+178 | 69.11 MB | 31 Oct 2009 - 23:30 |
Java (Often spam bot) | 25418+11 | 3.60 GB | 31 Oct 2009 - 23:29 |
BaiDuSpider | 4864+100 | 97.18 MB | 31 Oct 2009 - 23:28 |
Ask | 3764+164 | 304.91 MB | 31 Oct 2009 - 23:27 |
LiveJournal.com | 620 | 24.28 MB | 31 Oct 2009 - 23:25 |
Jakarta commons-httpclient | 961+12 | 313.82 MB | 31 Oct 2009 - 23:18 |
Unknown robot (identified by 'spider') | 9036+1132 | 35.63 MB | 31 Oct 2009 - 23:17 |
Voila | 5898+47 | 77.53 MB | 31 Oct 2009 - 23:16 |
Powermarks | 645 | 471.66 KB | 31 Oct 2009 - 23:13 |
HTTrack off-line browser | 35473+6 | 6.13 GB | 31 Oct 2009 - 23:07 |
Speedy Spider | 2231+265 | 9.52 MB | 31 Oct 2009 - 23:02 |
Yandex bot | 1934+119 | 11.06 MB | 31 Oct 2009 - 22:58 |
Unknown robot (identified by hit on 'robots.txt') | 0+5002 | 1.85 MB | 31 Oct 2009 - 22:53 |
Python-urllib | 451+14 | 105.18 MB | 31 Oct 2009 - 22:44 |
yacy | 184+69 | 6.42 MB | 31 Oct 2009 - 22:34 |
BSpider | 3+17 | 142.94 KB | 31 Oct 2009 - 22:27 |
The web archive (IA Archiver) | 0+460 | 173.40 KB | 31 Oct 2009 - 22:09 |
Girafabot | 0+6 | 2.26 KB | 31 Oct 2009 - 22:06 |
Motor | 15+2 | 1.01 MB | 31 Oct 2009 - 21:11 |
Web Core / Roots | 133 | 252.41 MB | 31 Oct 2009 - 21:10 |
UP.Browser | 297 | 34.28 MB | 31 Oct 2009 - 19:49 |
Unknown robot (identified by 'bot/' or 'bot-') | 11383+386 | 977.82 MB | 31 Oct 2009 - 18:43 |
CFNetwork | 436 | 2.32 GB | 31 Oct 2009 - 18:41 |
larbin | 37+24 | 602.88 KB | 31 Oct 2009 - 17:17 |
Alexa (IA Archiver) | 285+57 | 32.57 MB | 31 Oct 2009 - 16:14 |
VSE | 86 | 18.55 MB | 31 Oct 2009 - 15:28 |
Nutch | 1228+128 | 15.96 MB | 31 Oct 2009 - 12:23 |
TencentTraveler | 360 | 88.67 MB | 31 Oct 2009 - 12:04 |
Feedfetcher-Google | 64 | 10.58 MB | 31 Oct 2009 - 11:28 |
MSIECrawler | 71+12 | 4.67 MB | 31 Oct 2009 - 10:08 |
MJ12bot | 2851+18 | 87.44 MB | 31 Oct 2009 - 08:39 |
WebCollage | 189 | 11.39 MB | 31 Oct 2009 - 06:15 |
Xenu Link Sleuth | 74 | 20.89 KB | 31 Oct 2009 - 04:35 |
legs | 64+62 | 9.90 MB | 30 Oct 2009 - 23:51 |
DoCoMo | 79+23 | 1001.51 KB | 30 Oct 2009 - 23:33 |
WallPaper (alias crawlpaper) | 21 | 8.56 MB | 30 Oct 2009 - 18:43 |
Grub.org | 39 | 255.49 KB | 30 Oct 2009 - 18:27 |
NutchCVS | 18+1 | 259.16 KB | 30 Oct 2009 - 17:52 |
Dumbot | 17 | 2.92 MB | 30 Oct 2009 - 14:27 |
W3C Validator | 24 | 185.25 KB | 30 Oct 2009 - 12:09 |
Microsoft URL Control | 42 | 3.00 MB | 30 Oct 2009 - 10:56 |
Cursor | 43 | 7.70 MB | 30 Oct 2009 - 08:25 |
arks | 1 | 46.88 KB | 30 Oct 2009 - 08:11 |
lwp-request | 1 | 302 Bytes | 30 Oct 2009 - 06:34 |
InfoBot | 34+11 | 792.19 KB | 30 Oct 2009 - 05:55 |
The World Wide Web Worm | 1 | 3.65 KB | 30 Oct 2009 - 05:36 |
LinkWalker | 21+19 | 120.22 KB | 30 Oct 2009 - 01:34 |
Heritrix | 3191+35 | 56.99 MB | 30 Oct 2009 - 01:28 |
YahooSeeker Yahoo! Blog crawler | 2+3 | 19.99 KB | 30 Oct 2009 - 00:04 |
Google AdSense | 40 | 1.60 MB | 29 Oct 2009 - 21:26 |
WordPress | 218 | 46.28 MB | 29 Oct 2009 - 18:26 |
archive.org bot | 19+10 | 1.58 MB | 29 Oct 2009 - 14:57 |
BBot | 36 | 7.52 MB | 29 Oct 2009 - 11:37 |
Z-Add Link Checker | 1 | 181 Bytes | 29 Oct 2009 - 11:33 |
Muncher | 4 | 26.42 KB | 29 Oct 2009 - 04:45 |
Fish search | 68 | 40.10 MB | 29 Oct 2009 - 00:11 |
Yahoo! Slurp China | 269+80 | 8.47 MB | 28 Oct 2009 - 17:53 |
Susie | 2 | 12.86 KB | 28 Oct 2009 - 15:05 |
Holmes | 2+2 | 1002.05 KB | 28 Oct 2009 - 10:12 |
NewsGator Online | 6 | 0 | 27 Oct 2009 - 19:43 |
LinkScan | 2 | 52.51 KB | 26 Oct 2009 - 18:08 |
SurveyBot | 14 | 60.17 KB | 26 Oct 2009 - 17:48 |
UniversalFeedParser | 163 | 81.01 KB | 26 Oct 2009 - 11:04 |
FavOrg | 3 | 69.72 KB | 25 Oct 2009 - 15:47 |
HTMLParser | 1 | 3.90 KB | 24 Oct 2009 - 20:11 |
IBM Almaden Research Center WebFountain™ | 5+2 | 99.90 KB | 24 Oct 2009 - 18:22 |
mnoGoSearch search engine software | 4 | 17.61 KB | 24 Oct 2009 - 06:12 |
Yahoo-MMCrawler | 8927+7 | 2.50 GB | 24 Oct 2009 - 01:18 |
Turn It In | 201+1 | 6.45 MB | 23 Oct 2009 - 14:01 |
OmniExplorer Bot | 7+5 | 82.58 KB | 23 Oct 2009 - 06:44 |
SuperBot | 2 | 23.87 KB | 23 Oct 2009 - 04:50 |
Checkbot | 21 | 6.19 KB | 23 Oct 2009 - 03:23 |
psbot | 126+10 | 44.96 KB | 22 Oct 2009 - 14:01 |
W3C Link Checker | 4+4 | 2.77 KB | 21 Oct 2009 - 19:56 |
LinkChecker | 2+1 | 41.59 KB | 21 Oct 2009 - 19:33 |
Netcraft | 30 | 136.38 KB | 21 Oct 2009 - 11:39 |
Gaisbot | 9+27 | 3.95 MB | 21 Oct 2009 - 07:47 |
lwp-trivial | 1 | 11.22 KB | 20 Oct 2009 - 21:42 |
Kevin | 3 | 18.82 KB | 19 Oct 2009 - 09:32 |
BlogSearch | 27 | 961.48 KB | 19 Oct 2009 - 08:19 |
ASpider (Associative Spider) | 6+1 | 50.51 KB | 19 Oct 2009 - 07:07 |
ichiro | 52+3 | 1.52 MB | 16 Oct 2009 - 05:23 |
Ocelli | 152+1 | 1.19 MB | 14 Oct 2009 - 16:31 |
arianna.libero.it | 1+1 | 8.96 KB | 13 Oct 2009 - 15:45 |
Findlinks | 0+1 | 386 Bytes | 13 Oct 2009 - 11:56 |
Combine System | 2+2 | 13.80 KB | 13 Oct 2009 - 01:53 |
JoBo Java Web Robot | 0+1 | 386 Bytes | 10 Oct 2009 - 16:18 |
W3C jigsaw CSS Validator | 4 | 4.22 KB | 09 Oct 2009 - 23:27 |
Internet Shinchakubin | 6 | 1.00 MB | 08 Oct 2009 - 23:09 |
Y!J Yahoo Japan | 1 | 701.51 KB | 08 Oct 2009 - 04:11 |
Oracle Ultra Search | 1 | 1.56 MB | 07 Oct 2009 - 21:40 |
Ingrid | 2 | 11.71 KB | 06 Oct 2009 - 02:27 |
WebVac | 1930+1 | 11.28 MB | 05 Oct 2009 - 00:54 |
Robozilla | 42 | 171.47 KB | 03 Oct 2009 - 00:38 |