| 96 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 925917+273 | 20.53 GB | 30 Nov 2010 - 05:57 |
| Load Balancing Server | 522802 | 1.77 GB | 30 Nov 2010 - 05:58 |
| Yahoo Slurp | 73721+431 | 7.81 GB | 30 Nov 2010 - 05:57 |
| Yandex bot | 67529+212 | 5.03 GB | 30 Nov 2010 - 05:57 |
| Unknown robot (identified by 'bot/' or 'bot-') | 26375+4086 | 1.75 GB | 30 Nov 2010 - 05:56 |
| Nagios | 24823 | 86.45 MB | 30 Nov 2010 - 05:45 |
| Unknown robot (identified by 'crawl') | 15943+7744 | 404.86 MB | 30 Nov 2010 - 05:53 |
| MSNBot-media | 9479+1904 | 1.07 GB | 30 Nov 2010 - 04:25 |
| FAST Enterprise Crawler | 6195+45 | 217.44 MB | 29 Nov 2010 - 21:45 |
| WebVac | 4997+1 | 24.96 MB | 11 Nov 2010 - 08:12 |
| Exabot | 4343+59 | 15.84 MB | 30 Nov 2010 - 05:57 |
| BaiDuSpider | 3682+339 | 475.06 MB | 30 Nov 2010 - 05:50 |
| Unknown robot (identified by 'spider') | 2671+1279 | 34.96 MB | 30 Nov 2010 - 05:13 |
| Python-urllib | 3433 | 1.52 GB | 30 Nov 2010 - 05:26 |
| Voila | 2637+97 | 137.12 MB | 29 Nov 2010 - 23:44 |
| Heritrix | 2525+20 | 214.03 MB | 28 Nov 2010 - 13:06 |
| Java (Often spam bot) | 2112+3 | 236.74 MB | 30 Nov 2010 - 04:52 |
| Fish search | 2009 | 627.74 MB | 30 Nov 2010 - 04:54 |
| Feedfetcher-Google | 1697 | 243.76 MB | 30 Nov 2010 - 03:56 |
| MLBot | 1452+96 | 14.10 MB | 30 Nov 2010 - 03:51 |
| Unknown robot (identified by 'robot') | 1418+115 | 20.89 MB | 30 Nov 2010 - 04:43 |
| Speedy Spider | 1073+411 | 10.11 MB | 30 Nov 2010 - 05:37 |
| MSNBot | 1409+74 | 21.77 MB | 29 Nov 2010 - 20:23 |
| CFNetwork | 1421 | 943.87 MB | 30 Nov 2010 - 04:48 |
| UP.Browser | 1385 | 380.06 MB | 30 Nov 2010 - 05:17 |
| MJ12bot | 1195+150 | 26.96 MB | 30 Nov 2010 - 03:28 |
| Ask | 781+101 | 121.55 MB | 30 Nov 2010 - 05:27 |
| DoCoMo | 767+99 | 15.49 MB | 30 Nov 2010 - 05:46 |
| BSpider | 718+53 | 7.25 MB | 30 Nov 2010 - 04:30 |
| Nutch | 592+152 | 8.56 MB | 30 Nov 2010 - 05:05 |
| Motor | 661 | 42.15 MB | 29 Nov 2010 - 22:46 |
| Unknown robot (identified by hit on 'robots.txt') | 0+624 | 246.95 KB | 30 Nov 2010 - 05:10 |
| Web Core / Roots | 511 | 744.56 MB | 29 Nov 2010 - 19:54 |
| GigaBot | 351+152 | 1.89 MB | 30 Nov 2010 - 05:23 |
| Powermarks | 428 | 2.81 MB | 30 Nov 2010 - 05:51 |
| Alexa (IA Archiver) | 248+49 | 5.21 MB | 30 Nov 2010 - 05:10 |
| Custo | 254+38 | 23.36 MB | 29 Nov 2010 - 18:29 |
| Yahoo! Slurp China | 206+63 | 12.39 MB | 30 Nov 2010 - 05:56 |
| WordPress | 233 | 2.47 MB | 30 Nov 2010 - 01:50 |
| Jakarta commons-httpclient | 208 | 21.85 MB | 30 Nov 2010 - 05:43 |
| TencentTraveler | 135 | 31.27 MB | 29 Nov 2010 - 23:01 |
| The web archive (IA Archiver) | 4+120 | 925.26 KB | 30 Nov 2010 - 01:36 |
| MSIECrawler | 87+21 | 5.36 MB | 30 Nov 2010 - 04:26 |
| Findlinks | 94+5 | 924.08 KB | 29 Nov 2010 - 20:36 |
| VSE | 83+1 | 13.13 MB | 29 Nov 2010 - 17:05 |
| WebCollage | 73 | 7.08 MB | 30 Nov 2010 - 05:57 |
| HTTrack off-line browser | 50+10 | 12.92 MB | 29 Nov 2010 - 23:05 |
| W3C Validator | 57 | 238.93 KB | 16 Nov 2010 - 14:08 |
| Xenu Link Sleuth | 52 | 32.99 KB | 29 Nov 2010 - 20:07 |
| Ocelli | 36+1 | 178.46 KB | 06 Nov 2010 - 12:16 |
| Netcraft | 34 | 78.03 KB | 27 Nov 2010 - 13:32 |
| psbot | 17+15 | 1.10 MB | 29 Nov 2010 - 20:54 |
| Google AdSense | 32 | 1.35 MB | 29 Nov 2010 - 08:29 |
| legs | 9+21 | 896.32 KB | 25 Nov 2010 - 23:52 |
| VORTEX | 24 | 1.52 MB | 29 Nov 2010 - 21:39 |
| WallPaper (alias crawlpaper) | 23 | 1.65 MB | 29 Nov 2010 - 01:18 |
| larbin | 13+6 | 68.33 KB | 30 Nov 2010 - 02:36 |
| Voyager | 17 | 561.16 KB | 27 Nov 2010 - 22:34 |
| yacy | 5+11 | 169.63 KB | 28 Nov 2010 - 14:35 |
| NG 1.x (Exalead) | 15 | 431.42 KB | 26 Nov 2010 - 21:49 |
| EasyDL | 14 | 1.30 MB | 30 Nov 2010 - 01:44 |
| archive.org bot | 8+5 | 382.79 KB | 25 Nov 2010 - 07:48 |
| SurveyBot | 8+2 | 42.46 KB | 29 Nov 2010 - 21:51 |
| W3C jigsaw CSS Validator | 10 | 15.15 KB | 16 Nov 2010 - 14:09 |
| MojeekBot | 3+6 | 203.66 KB | 30 Nov 2010 - 02:17 |
| DNAbot | 5+3 | 42.57 KB | 18 Nov 2010 - 15:30 |
| W3C Link Checker | 4+4 | 2.66 KB | 29 Nov 2010 - 08:51 |
| Turn It In | 1+5 | 5.44 KB | 16 Nov 2010 - 04:56 |
| WebReaper | 0+4 | 1.66 KB | 03 Nov 2010 - 08:07 |
| StackRambler | 0+4 | 1.45 KB | 23 Nov 2010 - 20:31 |
| Feedburner | 4 | 1.34 KB | 01 Nov 2010 - 15:45 |
| NetMechanic | 2+2 | 1.27 KB | 27 Nov 2010 - 02:16 |
| Gaisbot | 0+4 | 1.66 KB | 29 Nov 2010 - 12:40 |
| Microsoft URL Control | 3 | 1.38 MB | 28 Nov 2010 - 02:52 |
| Cursor | 3 | 219.30 KB | 29 Nov 2010 - 20:14 |
| arianna.libero.it | 1+2 | 28.37 KB | 21 Nov 2010 - 06:41 |
| lwp-request | 3 | 1.03 MB | 29 Nov 2010 - 15:52 |
| YahooSeeker Yahoo! Blog crawler | 0+3 | 1.13 KB | 20 Nov 2010 - 23:28 |
| TITAN | 3 | 242.19 KB | 06 Nov 2010 - 00:28 |
| arks | 3 | 148.16 KB | 05 Nov 2010 - 09:12 |
| Netluchs | 1+1 | 4.62 KB | 19 Nov 2010 - 17:22 |
| Zeus Webster Pro | 2 | 28.19 KB | 07 Nov 2010 - 01:38 |
| Combine System | 1+1 | 386 Bytes | 01 Nov 2010 - 13:48 |
| Girafabot | 2 | 13.16 KB | 15 Nov 2010 - 01:14 |
| Digger | 1 | 12.79 KB | 08 Nov 2010 - 15:19 |
| SuperBot | 1 | 794 Bytes | 06 Nov 2010 - 00:28 |
| Grub.org | 1 | 43.42 KB | 10 Nov 2010 - 01:25 |
| Susie | 1 | 2.13 KB | 27 Nov 2010 - 12:33 |
| SpiderMan | 0+1 | 386 Bytes | 09 Nov 2010 - 18:34 |
| Pioneer | 1 | 36.42 KB | 02 Nov 2010 - 20:46 |
| BBot | 1 | 127.60 KB | 11 Nov 2010 - 11:29 |
| XGET | 1 | 203.54 KB | 22 Nov 2010 - 05:28 |
| Vagabondo | 0+1 | 386 Bytes | 02 Nov 2010 - 07:13 |
| Boris | 1 | 203.57 KB | 17 Nov 2010 - 10:28 |
| BlogSearch | 0+1 | 331 Bytes | 15 Nov 2010 - 13:17 |
| Emacs-w3 Search Engine | 1 | 45.50 KB | 07 Nov 2010 - 07:17 |