| 60 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'bot*') | 172650+750 | 17.71 GB | 31 Aug 2014 - 23:59 |
| Yahoo Slurp | 28043+43 | 9.12 GB | 31 Aug 2014 - 23:59 |
| Googlebot | 105326+745 | 130.58 GB | 31 Aug 2014 - 23:59 |
| BaiDuSpider | 11984+125 | 2.19 GB | 31 Aug 2014 - 23:58 |
| Unknown robot (identified by 'spider') | 7417+39 | 602.11 MB | 31 Aug 2014 - 23:53 |
| Feedfetcher-Google | 4688 | 393.42 MB | 31 Aug 2014 - 23:52 |
| Yandex bot | 16694+104 | 10.51 GB | 31 Aug 2014 - 23:36 |
| Java (Often spam bot) | 3679+17 | 405.91 MB | 31 Aug 2014 - 23:31 |
| MSNBot-media | 38+205 | 4.51 MB | 31 Aug 2014 - 23:29 |
| Unknown robot (identified by empty user agent string) | 10774+1 | 1.16 GB | 31 Aug 2014 - 23:22 |
| Unknown robot (identified by 'robot') | 258+33 | 51.95 MB | 31 Aug 2014 - 23:18 |
| FavIconizer | 204 | 110.87 MB | 31 Aug 2014 - 23:17 |
| Sogou Spider | 5596+134 | 1.21 GB | 31 Aug 2014 - 22:53 |
| Alexa (IA Archiver) | 116+50 | 29.02 MB | 31 Aug 2014 - 22:52 |
| Exabot | 577+38 | 16.28 MB | 31 Aug 2014 - 21:58 |
| Sift | 5 | 113.41 KB | 31 Aug 2014 - 21:55 |
| Unknown robot (identified by hit on 'robots.txt') | 0+467 | 39.22 KB | 31 Aug 2014 - 21:23 |
| Unknown robot (identified by '*bot') | 320+3 | 222.46 MB | 31 Aug 2014 - 20:44 |
| SeznamBot | 58+20 | 47.59 MB | 31 Aug 2014 - 19:58 |
| Perl tool | 95 | 19.27 MB | 31 Aug 2014 - 19:54 |
| FaceBook bot | 441 | 10.17 MB | 31 Aug 2014 - 19:44 |
| larbin | 478+7 | 23.55 MB | 31 Aug 2014 - 18:34 |
| MojeekBot | 1+1 | 36.10 KB | 31 Aug 2014 - 18:11 |
| MJ12bot | 299+77 | 18.90 MB | 31 Aug 2014 - 17:19 |
| psbot | 428+14 | 9.89 MB | 31 Aug 2014 - 10:55 |
| Jakarta commons-httpclient | 112+9 | 17.79 MB | 31 Aug 2014 - 09:15 |
| MagpieRSS | 0+32 | 2.69 KB | 31 Aug 2014 - 03:20 |
| Unknown robot (identified by 'crawl') | 17895+176 | 358.22 MB | 31 Aug 2014 - 03:16 |
| Python-urllib | 8300+6 | 362.35 MB | 31 Aug 2014 - 02:49 |
| WGet tools | 31+1 | 273.80 MB | 30 Aug 2014 - 23:34 |
| Harvest | 47 | 3.24 MB | 30 Aug 2014 - 23:11 |
| TITAN | 17 | 1.16 MB | 30 Aug 2014 - 21:30 |
| CFNetwork | 253 | 2.15 GB | 30 Aug 2014 - 19:30 |
| WordPress | 90 | 2.48 MB | 30 Aug 2014 - 13:22 |
| archive.org bot | 116+45 | 147.63 MB | 29 Aug 2014 - 23:04 |
| HTTrack off-line browser | 56+2 | 34.58 MB | 29 Aug 2014 - 19:52 |
| Unknown robot (identified by 'checker') | 65 | 24.25 KB | 29 Aug 2014 - 17:56 |
| Nutch | 16+16 | 204.56 KB | 29 Aug 2014 - 08:58 |
| Unknown robot (identified by 'discovery') | 5 | 95.79 KB | 29 Aug 2014 - 07:13 |
| yacy | 15+9 | 25.24 MB | 28 Aug 2014 - 05:32 |
| Checkbot | 5 | 9.71 KB | 28 Aug 2014 - 03:26 |
| WebFilter | 38+15 | 615.63 KB | 28 Aug 2014 - 02:26 |
| Mail.ru bot | 1182+174 | 548.63 MB | 27 Aug 2014 - 10:44 |
| Raven Search | 2 | 0 | 27 Aug 2014 - 05:14 |
| DoCoMo | 2+2 | 9.69 KB | 26 Aug 2014 - 13:58 |
| MSNBot | 15+7 | 233.73 KB | 26 Aug 2014 - 00:17 |
| VSE | 1+1 | 24.34 KB | 25 Aug 2014 - 14:15 |
| NG 2.x (Exalead) | 1 | 660.98 KB | 25 Aug 2014 - 12:08 |
| NG 1.x (Exalead) | 24 | 8.90 MB | 24 Aug 2014 - 08:20 |
| Phantom | 85 | 5.60 MB | 21 Aug 2014 - 00:24 |
| Heritrix | 296+1 | 669.26 MB | 18 Aug 2014 - 15:37 |
| RuLeS | 0+1 | 86 Bytes | 18 Aug 2014 - 13:02 |
| StackRambler | 2 | 2.09 MB | 17 Aug 2014 - 12:51 |
| Turn It In | 2+3 | 2.05 MB | 16 Aug 2014 - 15:08 |
| Netcraft | 1 | 8.70 KB | 14 Aug 2014 - 09:22 |
| Y!J Yahoo Japan | 1+1 | 1.34 MB | 13 Aug 2014 - 03:23 |
| Web Core / Roots | 59+1 | 15.64 MB | 12 Aug 2014 - 15:58 |
| BBot | 3 | 623.44 KB | 10 Aug 2014 - 13:14 |
| SuperBot | 1 | 27.04 KB | 06 Aug 2014 - 14:22 |
| WebCollage | 1 | 9.93 KB | 04 Aug 2014 - 20:13 |