99 different robots | Hits | Bandwidth | Last visit |
Load Balancing Server | 647541 | 3.00 GB | 30 Jun 2010 - 23:59 |
Googlebot | 476186+238 | 19.11 GB | 30 Jun 2010 - 23:59 |
Yahoo Slurp | 89888+479 | 10.13 GB | 30 Jun 2010 - 23:59 |
FAST Enterprise Crawler | 60962+62 | 2.89 GB | 29 Jun 2010 - 20:31 |
Unknown robot (identified by 'robot') | 56378+2510 | 363.02 MB | 30 Jun 2010 - 23:59 |
MSNBot | 30520+2376 | 3.18 GB | 30 Jun 2010 - 23:56 |
Unknown robot (identified by 'crawl') | 20279+8156 | 193.67 MB | 30 Jun 2010 - 23:41 |
Yandex bot | 19925+220 | 1.09 GB | 30 Jun 2010 - 23:45 |
Nagios | 12243 | 66.34 MB | 30 Jun 2010 - 23:51 |
MSNBot-media | 7977+2787 | 655.33 MB | 30 Jun 2010 - 23:59 |
Python-urllib | 9397+1 | 1.89 GB | 30 Jun 2010 - 23:33 |
Unknown robot (identified by 'bot/' or 'bot-') | 6556+1546 | 155.12 MB | 30 Jun 2010 - 23:49 |
WebVac | 5137+1 | 23.85 MB | 07 Jun 2010 - 16:26 |
Unknown robot (identified by 'spider') | 4146+644 | 119.61 MB | 30 Jun 2010 - 23:45 |
Java (Often spam bot) | 4249+14 | 2.06 GB | 30 Jun 2010 - 23:45 |
BaiDuSpider | 3475+328 | 105.05 MB | 30 Jun 2010 - 23:23 |
Exabot | 3663+67 | 8.35 MB | 30 Jun 2010 - 23:58 |
Voila | 2723+106 | 125.72 MB | 30 Jun 2010 - 23:33 |
Heritrix | 2432+15 | 246.92 MB | 30 Jun 2010 - 23:44 |
archive.org bot | 2269+12 | 519.95 MB | 27 Jun 2010 - 21:44 |
CFNetwork | 2037 | 3.01 GB | 30 Jun 2010 - 23:33 |
UP.Browser | 1768 | 271.82 MB | 30 Jun 2010 - 23:04 |
Speedy Spider | 1179+531 | 16.40 MB | 26 Jun 2010 - 06:03 |
Ask | 1235+289 | 107.47 MB | 30 Jun 2010 - 23:49 |
Unknown robot (identified by hit on 'robots.txt') | 0+1497 | 589.15 KB | 30 Jun 2010 - 23:24 |
MSIECrawler | 689+476 | 20.48 MB | 30 Jun 2010 - 23:41 |
Alexa (IA Archiver) | 1013+87 | 15.21 MB | 30 Jun 2010 - 23:57 |
Powermarks | 881 | 19.46 MB | 30 Jun 2010 - 23:27 |
Feedfetcher-Google | 872 | 69.34 MB | 30 Jun 2010 - 23:21 |
Nutch | 606+83 | 6.21 MB | 30 Jun 2010 - 18:00 |
MJ12bot | 453+48 | 12.37 MB | 30 Jun 2010 - 23:10 |
SpiderMan | 408+91 | 3.07 MB | 28 Jun 2010 - 06:09 |
Jakarta commons-httpclient | 419+10 | 66.79 MB | 30 Jun 2010 - 23:00 |
MLBot | 328+91 | 3.93 MB | 30 Jun 2010 - 23:35 |
WordPress | 369 | 93.76 MB | 30 Jun 2010 - 13:27 |
HTTrack off-line browser | 293+44 | 40.96 MB | 30 Jun 2010 - 22:21 |
Yahoo! Slurp China | 242+76 | 14.80 MB | 30 Jun 2010 - 18:38 |
Custo | 236+79 | 21.40 MB | 30 Jun 2010 - 21:04 |
Web Core / Roots | 278 | 419.57 MB | 30 Jun 2010 - 23:49 |
TencentTraveler | 223 | 75.01 MB | 30 Jun 2010 - 21:10 |
W3C Validator | 189 | 1.53 MB | 29 Jun 2010 - 01:31 |
Fish search | 165 | 27.25 MB | 30 Jun 2010 - 11:25 |
InfoBot | 150+1 | 3.09 MB | 16 Jun 2010 - 02:51 |
legs | 92+49 | 2.35 MB | 30 Jun 2010 - 12:02 |
DoCoMo | 67+70 | 4.54 MB | 30 Jun 2010 - 15:35 |
psbot | 126+6 | 8.45 MB | 01 Jun 2010 - 15:55 |
yacy | 33+92 | 802.37 KB | 30 Jun 2010 - 11:54 |
The web archive (IA Archiver) | 0+112 | 41.74 KB | 30 Jun 2010 - 23:36 |
VSE | 84+1 | 14.33 MB | 29 Jun 2010 - 05:42 |
Xenu Link Sleuth | 69 | 173.52 KB | 29 Jun 2010 - 16:13 |
larbin | 23+31 | 401.73 KB | 30 Jun 2010 - 06:59 |
BSpider | 6+43 | 482.21 KB | 30 Jun 2010 - 12:17 |
W3C jigsaw CSS Validator | 44 | 185.59 KB | 29 Jun 2010 - 01:17 |
Motor | 41+1 | 8.20 MB | 29 Jun 2010 - 08:53 |
DNAbot | 22+16 | 438.66 KB | 25 Jun 2010 - 12:41 |
Google AdSense | 36 | 1.25 MB | 30 Jun 2010 - 21:35 |
WallPaper (alias crawlpaper) | 33 | 1.11 MB | 30 Jun 2010 - 09:45 |
WebCollage | 30 | 924.62 KB | 30 Jun 2010 - 14:04 |
Netcraft | 30 | 137.39 KB | 18 Jun 2010 - 18:03 |
MSRBOT | 16+11 | 2.92 MB | 16 Jun 2010 - 09:15 |
Findlinks | 19+3 | 182.28 KB | 29 Jun 2010 - 08:49 |
ichiro | 8+14 | 222.72 KB | 28 Jun 2010 - 05:54 |
SurveyBot | 15+3 | 115.66 KB | 29 Jun 2010 - 12:22 |
ping.blo.gs | 14 | 425.78 KB | 30 Jun 2010 - 23:22 |
StackRambler | 12+1 | 465.20 KB | 30 Jun 2010 - 03:11 |
BBot | 12 | 4.26 MB | 30 Jun 2010 - 17:32 |
Feedburner | 11 | 3.70 KB | 30 Jun 2010 - 12:32 |
YahooSeeker Yahoo! Blog crawler | 0+11 | 3.66 KB | 13 Jun 2010 - 22:49 |
W3C Link Checker | 3+7 | 3.53 KB | 24 Jun 2010 - 14:02 |
Y!J Yahoo Japan | 9 | 441.40 KB | 30 Jun 2010 - 08:25 |
OmniExplorer Bot | 6 | 61.63 KB | 27 Jun 2010 - 19:45 |
EasyDL | 6 | 91.82 KB | 24 Jun 2010 - 05:53 |
NG 1.x (Exalead) | 6 | 118.45 KB | 23 Jun 2010 - 15:38 |
Gaisbot | 3+3 | 17.70 KB | 29 Jun 2010 - 19:58 |
Microsoft URL Control | 5 | 1.80 MB | 30 Jun 2010 - 20:11 |
Vagabondo | 2+3 | 93.90 KB | 13 Jun 2010 - 19:21 |
Voyager | 5 | 121.29 KB | 28 Jun 2010 - 18:07 |
Web Downloader | 3 | 1.68 MB | 21 Jun 2010 - 09:16 |
NutchCVS | 2+1 | 6.51 KB | 03 Jun 2010 - 14:41 |
TITAN | 3 | 1.59 MB | 26 Jun 2010 - 20:27 |
JBot Java Web Robot | 2 | 4.21 KB | 20 Jun 2010 - 20:52 |
Digger | 2 | 24.05 KB | 13 Jun 2010 - 09:20 |
Susie | 2 | 7.15 KB | 12 Jun 2010 - 04:07 |
Cursor | 2 | 126.64 KB | 13 Jun 2010 - 06:51 |
Crawl libcrawl | 1+1 | 3.97 KB | 15 Jun 2010 - 17:44 |
lwp-request | 2 | 606 Bytes | 10 Jun 2010 - 16:54 |
lwp-trivial | 1+1 | 203.95 KB | 21 Jun 2010 - 04:33 |
Patric | 1 | 65.07 KB | 28 Jun 2010 - 00:32 |
SuperBot | 1 | 798.25 KB | 02 Jun 2010 - 13:49 |
Internet Shinchakubin | 1 | 113.85 KB | 22 Jun 2010 - 17:48 |
Webdup | 1 | 245.90 KB | 26 Jun 2010 - 00:14 |
Fluid Dynamics Search Engine robot | 0+1 | 386 Bytes | 04 Jun 2010 - 08:32 |
Muncher | 1 | 32.98 KB | 27 Jun 2010 - 03:00 |
HTMLParser | 1 | 16.71 KB | 11 Jun 2010 - 23:10 |
UCSD Crawl | 1 | 261.22 KB | 04 Jun 2010 - 12:37 |
Walhello appie | 1 | 7.86 KB | 10 Jun 2010 - 17:47 |
mnoGoSearch search engine software | 1 | 832 Bytes | 17 Jun 2010 - 10:15 |
BlogSearch | 0+1 | 331 Bytes | 15 Jun 2010 - 14:25 |
arks | 1 | 515.82 KB | 16 Jun 2010 - 14:17 |