| 60 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'bot*') | 204430+676 | 16.69 GB | 31 May 2014 - 23:59 |
| Googlebot | 104013+756 | 124.80 GB | 31 May 2014 - 23:59 |
| Unknown robot (identified by empty user agent string) | 51308+4 | 6.56 GB | 31 May 2014 - 22:58 |
| Unknown robot (identified by hit on 'robots.txt') | 0+26096 | 2.14 MB | 31 May 2014 - 23:32 |
| Yahoo Slurp | 23663+58 | 8.33 GB | 31 May 2014 - 23:55 |
| Yandex bot | 16390+73 | 11.17 GB | 31 May 2014 - 20:59 |
| Java (Often spam bot) | 14769+25 | 1.36 GB | 31 May 2014 - 23:36 |
| Heritrix | 10442+9 | 81.40 GB | 17 May 2014 - 21:41 |
| Unknown robot (identified by 'crawl') | 8737+135 | 101.81 MB | 31 May 2014 - 21:21 |
| Unknown robot (identified by 'spider') | 5830+333 | 404.63 MB | 31 May 2014 - 23:48 |
| Sogou Spider | 5881+114 | 2.26 GB | 31 May 2014 - 21:56 |
| Feedfetcher-Google | 5255 | 426.49 MB | 31 May 2014 - 23:58 |
| BaiDuSpider | 3248+39 | 1.35 GB | 31 May 2014 - 23:59 |
| psbot | 882+25 | 20.55 MB | 31 May 2014 - 01:36 |
| Unknown robot (identified by '*bot') | 455+356 | 26.61 MB | 29 May 2014 - 07:20 |
| Exabot | 584+47 | 16.53 MB | 31 May 2014 - 22:38 |
| FaceBook bot | 500 | 15.69 MB | 31 May 2014 - 21:00 |
| Mail.ru bot | 322+133 | 729.54 MB | 31 May 2014 - 23:04 |
| Unknown robot (identified by 'robot') | 230+42 | 48.03 MB | 31 May 2014 - 17:51 |
| WGet tools | 267 | 263.52 MB | 31 May 2014 - 16:22 |
| MJ12bot | 202+63 | 17.66 MB | 31 May 2014 - 22:00 |
| MSNBot-media | 129+127 | 17.85 MB | 31 May 2014 - 22:15 |
| Jakarta commons-httpclient | 219+1 | 27.65 MB | 31 May 2014 - 18:19 |
| HTTrack off-line browser | 186+5 | 64.01 MB | 29 May 2014 - 05:17 |
| FavIconizer | 184 | 83.68 MB | 31 May 2014 - 23:51 |
| yacy | 156+10 | 79.03 MB | 29 May 2014 - 02:09 |
| WordPress | 144 | 48.36 MB | 31 May 2014 - 21:01 |
| Harvest | 132 | 28.07 MB | 31 May 2014 - 17:55 |
| Alexa (IA Archiver) | 79+46 | 19.51 MB | 31 May 2014 - 19:50 |
| CFNetwork | 117 | 493.92 MB | 31 May 2014 - 14:19 |
| Web Core / Roots | 106+2 | 4.47 MB | 30 May 2014 - 06:14 |
| MSNBot | 74+26 | 11.87 MB | 31 May 2014 - 00:53 |
| Perl tool | 83 | 13.97 MB | 31 May 2014 - 23:24 |
| WebFilter | 53+27 | 658.22 KB | 31 May 2014 - 01:04 |
| SeznamBot | 29+17 | 55.08 MB | 31 May 2014 - 00:23 |
| Phantom | 43 | 6.32 MB | 29 May 2014 - 19:14 |
| archive.org bot | 4+32 | 131.82 MB | 31 May 2014 - 11:55 |
| MagpieRSS | 0+35 | 2.94 KB | 30 May 2014 - 21:51 |
| Python-urllib | 12+10 | 25.42 MB | 31 May 2014 - 21:15 |
| DoCoMo | 18+3 | 475.22 KB | 27 May 2014 - 21:49 |
| Nutch | 9+9 | 158.94 KB | 17 May 2014 - 21:02 |
| NG 1.x (Exalead) | 14 | 10.41 MB | 22 May 2014 - 00:24 |
| the World Wide Web Wanderer | 9 | 47.80 KB | 06 May 2014 - 06:28 |
| Unknown robot (identified by 'checker') | 7 | 119.92 KB | 12 May 2014 - 23:23 |
| Unknown robot (identified by 'discovery') | 6 | 176.02 KB | 25 May 2014 - 04:49 |
| VSE | 3+3 | 72.37 KB | 30 May 2014 - 12:55 |
| BBot | 6 | 11.17 MB | 18 May 2014 - 07:05 |
| NG 2.x (Exalead) | 6 | 77.18 KB | 26 May 2014 - 03:38 |
| Checkbot | 5 | 0 | 29 May 2014 - 03:46 |
| LinkScan | 5 | 74.69 KB | 11 May 2014 - 23:49 |
| W3C Validator | 4 | 61.23 KB | 21 May 2014 - 02:16 |
| GigaBot | 3 | 39.37 KB | 13 May 2014 - 10:04 |
| TITAN | 2 | 56.34 KB | 27 May 2014 - 10:03 |
| Turn It In | 1+1 | 51.83 KB | 21 May 2014 - 19:06 |
| Y!J Yahoo Japan | 1+1 | 763.02 KB | 22 May 2014 - 02:47 |
| Tarantula | 1+1 | 6.65 MB | 29 May 2014 - 03:46 |
| larbin | 1+1 | 8.49 KB | 22 May 2014 - 01:08 |
| StackRambler | 1 | 2.60 MB | 29 May 2014 - 21:56 |
| Raven Search | 1 | 0 | 23 May 2014 - 02:24 |
| Netcraft | 1 | 8.41 KB | 15 May 2014 - 16:19 |