112 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 191545+395 | 17.29 GB | 21 Jan 2009 - 18:37 |
Googlebot | 128818+40 | 4.65 GB | 21 Jan 2009 - 18:37 |
MSNBot | 87020+499 | 831.65 MB | 21 Jan 2009 - 18:36 |
MLBot | 62669+23 | 428.22 MB | 21 Jan 2009 - 18:33 |
MSNBot-media | 34117+2715 | 7.21 GB | 21 Jan 2009 - 18:35 |
Unknown robot (identified by 'robot') | 35139+450 | 250.71 MB | 21 Jan 2009 - 18:35 |
Nagios | 12835 | 48.01 MB | 21 Jan 2009 - 18:30 |
Java (Often spam bot) | 11592+3 | 77.30 MB | 21 Jan 2009 - 18:10 |
Exabot | 7725+13 | 66.62 MB | 21 Jan 2009 - 18:24 |
Unknown robot (identified by 'crawl') | 6336+122 | 667.39 MB | 21 Jan 2009 - 18:11 |
WebVac | 5235+1 | 28.10 MB | 07 Jan 2009 - 12:21 |
Unknown robot (identified by 'spider') | 3619+995 | 35.11 MB | 21 Jan 2009 - 18:00 |
Voila | 3625+28 | 68.19 MB | 21 Jan 2009 - 18:33 |
MJ12bot | 2883+5 | 65.46 MB | 20 Jan 2009 - 10:52 |
Unknown robot (identified by hit on 'robots.txt') | 0+2308 | 852.13 KB | 21 Jan 2009 - 18:33 |
Yahoo! Slurp China | 1486+183 | 23.52 MB | 21 Jan 2009 - 18:37 |
BaiDuSpider | 1486+35 | 34.17 MB | 21 Jan 2009 - 18:35 |
Ask | 1192+76 | 153.91 MB | 21 Jan 2009 - 17:20 |
Nutch | 653+76 | 20.53 MB | 21 Jan 2009 - 13:24 |
Speedy Spider | 599+66 | 12.81 MB | 21 Jan 2009 - 18:15 |
Asterias | 651 | 13.15 MB | 21 Jan 2009 - 17:17 |
Gaisbot | 582+35 | 17.04 MB | 21 Jan 2009 - 08:19 |
Unknown robot (identified by 'bot/' or 'bot-') | 552+57 | 11.60 MB | 21 Jan 2009 - 16:20 |
FAST Enterprise Crawler | 580 | 9.41 MB | 14 Jan 2009 - 11:39 |
HTTrack off-line browser | 528+5 | 522.09 MB | 21 Jan 2009 - 01:46 |
ConveraCrawler | 478+12 | 6.03 MB | 21 Jan 2009 - 12:08 |
CFNetwork | 422 | 8.04 GB | 21 Jan 2009 - 16:48 |
The web archive (IA Archiver) | 0+405 | 154.14 KB | 21 Jan 2009 - 17:02 |
Yahoo-MMCrawler | 194+171 | 13.21 MB | 05 Jan 2009 - 10:21 |
VSE | 293+2 | 13.46 MB | 18 Jan 2009 - 15:20 |
WebCollage | 292 | 22.29 MB | 21 Jan 2009 - 08:43 |
Python-urllib | 252+10 | 53.15 MB | 21 Jan 2009 - 09:54 |
Voyager | 257+5 | 6.28 MB | 20 Jan 2009 - 23:34 |
InfoBot | 221+3 | 2.08 MB | 20 Jan 2009 - 18:00 |
Yandex bot | 198+9 | 2.38 MB | 21 Jan 2009 - 01:26 |
Grub.org | 189+12 | 6.69 MB | 21 Jan 2009 - 17:23 |
GigaBot | 152+31 | 1.24 MB | 21 Jan 2009 - 18:04 |
Ocelli | 155 | 12.62 MB | 18 Jan 2009 - 20:43 |
MagpieRSS | 131 | 37.57 MB | 14 Jan 2009 - 10:48 |
DoCoMo | 120+7 | 10.29 MB | 21 Jan 2009 - 15:16 |
Feedfetcher-Google | 126 | 340.44 KB | 21 Jan 2009 - 18:08 |
WebReaper | 123+3 | 2.51 MB | 08 Jan 2009 - 02:46 |
Jakarta commons-httpclient | 115+8 | 4.93 MB | 21 Jan 2009 - 15:35 |
Powermarks | 111 | 282.30 KB | 21 Jan 2009 - 18:33 |
LiveJournal.com | 92 | 1.39 MB | 21 Jan 2009 - 16:05 |
MSIECrawler | 49+33 | 547.16 KB | 21 Jan 2009 - 02:32 |
NewsGator Online | 81 | 0 | 21 Jan 2009 - 14:32 |
Custo | 60+10 | 1.94 MB | 21 Jan 2009 - 04:47 |
StackRambler | 59+6 | 1.31 MB | 19 Jan 2009 - 05:30 |
UP.Browser | 57 | 1.22 MB | 21 Jan 2009 - 13:56 |
BSpider | 30+24 | 301.86 KB | 21 Jan 2009 - 16:23 |
SpiderMan | 45 | 287.11 KB | 16 Jan 2009 - 00:39 |
BlogPulse ISSpider intelliseek.com | 28+14 | 1.25 MB | 20 Jan 2009 - 22:54 |
TencentTraveler | 40 | 15.50 MB | 21 Jan 2009 - 15:22 |
MojeekBot | 37+3 | 202.73 KB | 19 Jan 2009 - 02:42 |
larbin | 22+18 | 1.94 MB | 21 Jan 2009 - 15:46 |
Feedburner | 39 | 12.99 KB | 08 Jan 2009 - 17:59 |
lwp-request | 36 | 43.21 KB | 19 Jan 2009 - 19:11 |
Y!J Yahoo Japan | 33 | 322.78 KB | 21 Jan 2009 - 04:33 |
Wells Search | 33 | 458.61 KB | 21 Jan 2009 - 11:35 |
BlogSearch | 24 | 819.34 KB | 21 Jan 2009 - 09:24 |
Xenu Link Sleuth | 24 | 6.91 KB | 18 Jan 2009 - 23:38 |
BBot | 22 | 7.47 MB | 13 Jan 2009 - 22:14 |
Netcraft | 22 | 119.71 KB | 21 Jan 2009 - 04:45 |
HTMLParser | 22 | 131.08 KB | 21 Jan 2009 - 02:29 |
yacy | 14+5 | 108.48 KB | 17 Jan 2009 - 19:08 |
BecomeBot | 16+3 | 176.89 KB | 20 Jan 2009 - 13:08 |
VORTEX | 19 | 217.09 KB | 19 Jan 2009 - 11:59 |
LinkChecker | 4+14 | 6.38 KB | 04 Jan 2009 - 19:45 |
Microsoft URL Control | 17 | 1.09 MB | 18 Jan 2009 - 11:23 |
Checkbot | 17 | 5.01 KB | 21 Jan 2009 - 03:21 |
Holmes | 9+5 | 4.99 MB | 21 Jan 2009 - 12:29 |
WordPress | 11 | 3.22 MB | 18 Jan 2009 - 21:06 |
Vagabondo | 7+3 | 69.09 KB | 21 Jan 2009 - 00:29 |
Steeler | 10 | 314.48 KB | 18 Jan 2009 - 15:53 |
Google AdSense | 10 | 806.23 KB | 19 Jan 2009 - 17:01 |
Alexa (IA Archiver) | 4+6 | 27.80 KB | 19 Jan 2009 - 21:58 |
LinkWalker | 7+2 | 20.30 KB | 15 Jan 2009 - 12:09 |
Missigua_Locator | 8 | 79.49 KB | 16 Jan 2009 - 21:31 |
SurveyBot | 4+4 | 49.49 KB | 21 Jan 2009 - 13:00 |
lwp-trivial | 8 | 1.53 MB | 21 Jan 2009 - 14:18 |
Scooter | 0+7 | 2.64 KB | 19 Jan 2009 - 09:47 |
Combine System | 2+4 | 20.33 KB | 16 Jan 2009 - 22:13 |
archive.org bot | 3+3 | 189.14 KB | 15 Jan 2009 - 17:15 |
Web Core / Roots | 5 | 5.51 MB | 16 Jan 2009 - 01:41 |
Motor | 5 | 15.92 KB | 19 Jan 2009 - 22:22 |
Fish search | 4 | 181.74 KB | 12 Jan 2009 - 07:14 |
TITAN | 4 | 242.17 KB | 07 Jan 2009 - 18:28 |
W3C Validator | 3 | 13.71 KB | 18 Jan 2009 - 13:05 |
Cursor | 3 | 17.85 KB | 09 Jan 2009 - 14:26 |
Zeus Webster Pro | 3 | 50.95 KB | 16 Jan 2009 - 18:40 |
Pioneer | 3 | 42.84 KB | 17 Jan 2009 - 17:39 |
Heritrix | 0+3 | 1.13 KB | 20 Jan 2009 - 13:02 |
Web Downloader | 3 | 32.76 KB | 16 Jan 2009 - 03:32 |
W3C jigsaw CSS Validator | 3 | 11.98 KB | 18 Jan 2009 - 13:05 |
LinkScan | 3 | 103.93 KB | 12 Jan 2009 - 06:02 |
Snappy | 2 | 24.16 KB | 20 Jan 2009 - 13:32 |
FavOrg | 2 | 6.31 KB | 18 Jan 2009 - 10:07 |
NG 2.x (Exalead) | 0+2 | 2.30 KB | 05 Jan 2009 - 22:20 |
YahooSeeker Yahoo! Blog crawler | 0+2 | 772 Bytes | 11 Jan 2009 - 21:58 |
Sunrise | 2 | 18.87 KB | 02 Jan 2009 - 14:15 |
W3C Link Checker | 2 | 4.54 KB | 14 Jan 2009 - 17:32 |
SuperBot | 1 | 1.12 KB | 16 Jan 2009 - 08:32 |
Kevin | 1 | 291.12 KB | 17 Jan 2009 - 09:11 |
Z-Add Link Checker | 1 | 181 Bytes | 03 Jan 2009 - 14:42 |
NASA Search | 1 | 9.52 KB | 07 Jan 2009 - 19:36 |
ComputingSite Robi/1.0 | 0+1 | 424 Bytes | 17 Jan 2009 - 16:03 |
Findlinks | 0+1 | 386 Bytes | 02 Jan 2009 - 16:23 |
JoBo Java Web Robot | 1 | 1.56 MB | 21 Jan 2009 - 11:56 |
EasyDL | 1 | 9.79 KB | 09 Jan 2009 - 08:43 |
mnoGoSearch search engine software | 1 | 15.64 KB | 13 Jan 2009 - 17:48 |
arks | 0+1 | 386 Bytes | 09 Jan 2009 - 21:38 |