| 89 different robots | Hits | Bandwidth | Last visit |
|---|
| Exabot | 4285+33 | 15.65 MB | 30 Nov 2010 - 05:57 |
| Load Balancing Server | 83164 | 1.01 GB | 30 Nov 2010 - 05:57 |
| Yahoo Slurp | 67710+156 | 6.94 GB | 30 Nov 2010 - 05:57 |
| Googlebot | 880837+42 | 20.40 GB | 30 Nov 2010 - 05:57 |
| Yandex bot | 66625+86 | 5.02 GB | 30 Nov 2010 - 05:57 |
| Yahoo! Slurp China | 196+22 | 12.35 MB | 30 Nov 2010 - 05:56 |
| Unknown robot (identified by 'bot/' or 'bot-') | 24721+1188 | 1.71 GB | 30 Nov 2010 - 05:56 |
| Unknown robot (identified by 'crawl') | 9781+5147 | 100.87 MB | 30 Nov 2010 - 05:53 |
| Powermarks | 420 | 899.72 KB | 30 Nov 2010 - 05:51 |
| BaiDuSpider | 1625+94 | 466.13 MB | 30 Nov 2010 - 05:50 |
| DoCoMo | 726+62 | 15.26 MB | 30 Nov 2010 - 05:46 |
| Nagios | 17342 | 45.27 MB | 30 Nov 2010 - 05:45 |
| Jakarta commons-httpclient | 206 | 21.16 MB | 30 Nov 2010 - 05:43 |
| Speedy Spider | 989+299 | 9.22 MB | 30 Nov 2010 - 05:37 |
| Ask | 755+76 | 118.87 MB | 30 Nov 2010 - 05:27 |
| GigaBot | 340+139 | 1.82 MB | 30 Nov 2010 - 05:23 |
| Unknown robot (identified by 'spider') | 2617+1214 | 34.64 MB | 30 Nov 2010 - 05:13 |
| Unknown robot (identified by hit on 'robots.txt') | 0+411 | 160.31 KB | 30 Nov 2010 - 05:10 |
| Alexa (IA Archiver) | 245+47 | 5.19 MB | 30 Nov 2010 - 05:10 |
| Nutch | 573+134 | 8.49 MB | 30 Nov 2010 - 05:05 |
| Fish search | 2007 | 627.04 MB | 30 Nov 2010 - 04:54 |
| Java (Often spam bot) | 1953+2 | 230.37 MB | 30 Nov 2010 - 04:52 |
| CFNetwork | 1407 | 924.55 MB | 30 Nov 2010 - 04:48 |
| Unknown robot (identified by 'robot') | 937+56 | 18.32 MB | 30 Nov 2010 - 04:43 |
| MSIECrawler | 78+16 | 1.72 MB | 30 Nov 2010 - 04:26 |
| MSNBot-media | 9361+1836 | 1.06 GB | 30 Nov 2010 - 04:25 |
| Feedfetcher-Google | 1698 | 243.93 MB | 30 Nov 2010 - 03:56 |
| MLBot | 1135+34 | 12.04 MB | 30 Nov 2010 - 03:51 |
| Python-urllib | 363 | 233.49 MB | 30 Nov 2010 - 03:44 |
| UP.Browser | 1382 | 380.01 MB | 30 Nov 2010 - 02:47 |
| BSpider | 374+24 | 5.17 MB | 30 Nov 2010 - 02:44 |
| larbin | 7+3 | 41.51 KB | 30 Nov 2010 - 02:36 |
| WordPress | 225 | 2.31 MB | 30 Nov 2010 - 01:50 |
| EasyDL | 14 | 1.30 MB | 30 Nov 2010 - 01:44 |
| The web archive (IA Archiver) | 4+108 | 921.38 KB | 30 Nov 2010 - 01:36 |
| Voila | 2577+71 | 134.09 MB | 29 Nov 2010 - 23:44 |
| HTTrack off-line browser | 50+2 | 12.92 MB | 29 Nov 2010 - 23:05 |
| WebCollage | 35 | 4.93 MB | 29 Nov 2010 - 22:49 |
| Motor | 652 | 41.92 MB | 29 Nov 2010 - 22:46 |
| FAST Enterprise Crawler | 6072+26 | 201.09 MB | 29 Nov 2010 - 21:45 |
| VORTEX | 24 | 1.52 MB | 29 Nov 2010 - 21:39 |
| psbot | 17+14 | 1.10 MB | 29 Nov 2010 - 20:54 |
| MJ12bot | 1086+79 | 25.47 MB | 29 Nov 2010 - 20:52 |
| Findlinks | 66+2 | 770.11 KB | 29 Nov 2010 - 20:36 |
| MSNBot | 1372+45 | 21.55 MB | 29 Nov 2010 - 20:23 |
| Cursor | 3 | 219.30 KB | 29 Nov 2010 - 20:14 |
| Xenu Link Sleuth | 48 | 31.96 KB | 29 Nov 2010 - 20:07 |
| Web Core / Roots | 509 | 744.56 MB | 29 Nov 2010 - 19:54 |
| Custo | 234+25 | 21.42 MB | 29 Nov 2010 - 17:44 |
| VSE | 82+1 | 13.12 MB | 29 Nov 2010 - 16:42 |
| lwp-request | 3 | 1.03 MB | 29 Nov 2010 - 15:52 |
| Gaisbot | 0+4 | 1.66 KB | 29 Nov 2010 - 12:40 |
| TencentTraveler | 124 | 31.23 MB | 29 Nov 2010 - 10:36 |
| W3C Link Checker | 2+2 | 1.38 KB | 29 Nov 2010 - 08:51 |
| Google AdSense | 32 | 1.35 MB | 29 Nov 2010 - 08:29 |
| WallPaper (alias crawlpaper) | 23 | 1.65 MB | 29 Nov 2010 - 01:18 |
| SurveyBot | 5 | 32.67 KB | 28 Nov 2010 - 14:12 |
| Heritrix | 2478+17 | 213.77 MB | 28 Nov 2010 - 13:06 |
| Voyager | 17 | 561.16 KB | 27 Nov 2010 - 22:34 |
| NetMechanic | 2+2 | 1.27 KB | 27 Nov 2010 - 02:16 |
| NG 1.x (Exalead) | 15 | 431.42 KB | 26 Nov 2010 - 21:49 |
| Netcraft | 9 | 38.35 KB | 26 Nov 2010 - 12:24 |
| legs | 8+19 | 194.09 KB | 25 Nov 2010 - 23:52 |
| archive.org bot | 8+5 | 382.79 KB | 25 Nov 2010 - 07:48 |
| StackRambler | 0+3 | 1.13 KB | 23 Nov 2010 - 20:31 |
| yacy | 4+8 | 65.61 KB | 23 Nov 2010 - 04:01 |
| XGET | 1 | 203.54 KB | 22 Nov 2010 - 05:28 |
| arianna.libero.it | 1+2 | 28.37 KB | 21 Nov 2010 - 06:41 |
| YahooSeeker Yahoo! Blog crawler | 0+3 | 1.13 KB | 20 Nov 2010 - 23:28 |
| Microsoft URL Control | 1 | 12.77 KB | 20 Nov 2010 - 04:15 |
| MojeekBot | 2+5 | 201.23 KB | 18 Nov 2010 - 22:51 |
| DNAbot | 5+3 | 42.57 KB | 18 Nov 2010 - 15:30 |
| Boris | 1 | 203.57 KB | 17 Nov 2010 - 10:28 |
| W3C jigsaw CSS Validator | 6 | 7.33 KB | 16 Nov 2010 - 14:09 |
| W3C Validator | 5 | 15.80 KB | 16 Nov 2010 - 14:08 |
| Girafabot | 2 | 13.16 KB | 15 Nov 2010 - 01:14 |
| BBot | 1 | 127.60 KB | 11 Nov 2010 - 11:29 |
| WebVac | 4997+1 | 24.96 MB | 11 Nov 2010 - 08:12 |
| SpiderMan | 0+1 | 386 Bytes | 09 Nov 2010 - 18:34 |
| Digger | 1 | 12.79 KB | 08 Nov 2010 - 15:19 |
| Emacs-w3 Search Engine | 1 | 45.50 KB | 07 Nov 2010 - 07:17 |
| Zeus Webster Pro | 2 | 28.19 KB | 07 Nov 2010 - 01:38 |
| TITAN | 3 | 242.19 KB | 06 Nov 2010 - 00:28 |
| SuperBot | 1 | 794 Bytes | 06 Nov 2010 - 00:28 |
| arks | 3 | 148.16 KB | 05 Nov 2010 - 09:12 |
| WebReaper | 0+4 | 1.66 KB | 03 Nov 2010 - 08:07 |
| Vagabondo | 0+1 | 386 Bytes | 02 Nov 2010 - 07:13 |
| Feedburner | 4 | 1.34 KB | 01 Nov 2010 - 15:45 |
| Combine System | 1+1 | 386 Bytes | 01 Nov 2010 - 13:48 |