| 56 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 87274+803 | 188.14 GB | 31 Jan 2017 - 23:59 |
| Unknown robot (identified by 'bot*') | 74490+651 | 18.33 GB | 31 Jan 2017 - 23:59 |
| Yahoo Slurp | 54598+48 | 5.96 GB | 31 Jan 2017 - 23:59 |
| BaiDuSpider | 50221+21 | 6.00 GB | 31 Jan 2017 - 23:59 |
| Yandex bot | 37571+129 | 20.16 GB | 31 Jan 2017 - 23:59 |
| Python-urllib | 28221+2 | 848.32 MB | 31 Jan 2017 - 18:39 |
| Sogou Spider | 20435+691 | 2.15 GB | 31 Jan 2017 - 23:59 |
| Nagios | 14883 | 126.41 MB | 31 Jan 2017 - 23:59 |
| Unknown robot (identified by 'crawl') | 14615+130 | 623.40 MB | 31 Jan 2017 - 22:25 |
| Exabot | 13133+29 | 971.89 MB | 31 Jan 2017 - 22:06 |
| Web Core / Roots | 9047 | 127.00 MB | 30 Jan 2017 - 20:44 |
| WGet tools | 6289+1 | 81.43 GB | 31 Jan 2017 - 08:20 |
| Unknown robot (identified by hit on 'robots.txt') | 0+3754 | 366.60 KB | 31 Jan 2017 - 23:50 |
| Java (Often spam bot) | 3485+1 | 23.23 GB | 31 Jan 2017 - 22:05 |
| Unknown robot (identified by empty user agent string) | 1716+13 | 1.49 GB | 31 Jan 2017 - 23:59 |
| Feedfetcher-Google | 1386 | 178.26 MB | 31 Jan 2017 - 23:47 |
| MSNBot-media | 648 | 336.50 MB | 30 Jan 2017 - 14:43 |
| yacy | 546+18 | 233.27 MB | 30 Jan 2017 - 07:55 |
| Unknown robot (identified by 'checker') | 424 | 12.40 MB | 28 Jan 2017 - 09:01 |
| FavIconizer | 367 | 99.25 MB | 31 Jan 2017 - 22:16 |
| Unknown robot (identified by 'robot') | 201+151 | 48.24 MB | 31 Jan 2017 - 17:26 |
| Perl tool | 335 | 34.98 MB | 31 Jan 2017 - 23:05 |
| CFNetwork | 287 | 500.34 MB | 31 Jan 2017 - 22:16 |
| SeznamBot | 116+115 | 646.47 KB | 31 Jan 2017 - 23:02 |
| FaceBook bot | 220 | 10.15 MB | 31 Jan 2017 - 23:31 |
| Nutch | 197+22 | 22.05 MB | 29 Jan 2017 - 11:21 |
| Unknown robot (identified by 'spider') | 160+8 | 137.90 MB | 31 Jan 2017 - 11:20 |
| Alexa (IA Archiver) | 77+53 | 68.97 MB | 31 Jan 2017 - 09:56 |
| MJ12bot | 70+58 | 1.61 MB | 31 Jan 2017 - 23:35 |
| Unknown robot (identified by '*bot') | 91+11 | 46.73 MB | 30 Jan 2017 - 22:54 |
| Jakarta commons-httpclient | 76 | 3.59 MB | 31 Jan 2017 - 12:52 |
| archive.org bot | 51+19 | 16.44 MB | 31 Jan 2017 - 07:31 |
| Sift | 45 | 993.94 KB | 31 Jan 2017 - 12:58 |
| WordPress | 41 | 0 | 29 Jan 2017 - 19:55 |
| Harvest | 37 | 994.60 KB | 28 Jan 2017 - 19:50 |
| NewsGator Online | 32 | 4.51 MB | 31 Jan 2017 - 13:50 |
| psbot | 20+1 | 526.44 KB | 10 Jan 2017 - 08:25 |
| arks | 19 | 39.52 MB | 06 Jan 2017 - 12:21 |
| Turn It In | 11+6 | 588.26 KB | 26 Jan 2017 - 07:12 |
| Custo | 15 | 2.17 MB | 06 Jan 2017 - 19:14 |
| LinkBot | 10 | 236.30 KB | 24 Jan 2017 - 01:28 |
| MojeekBot | 4+5 | 85.74 KB | 27 Jan 2017 - 09:21 |
| UniversalFeedParser | 7 | 0 | 23 Jan 2017 - 11:24 |
| W3C Link Checker | 3+3 | 300 Bytes | 13 Jan 2017 - 10:00 |
| NG 1.x (Exalead) | 5 | 10.65 MB | 24 Jan 2017 - 21:37 |
| Unknown robot (identified by 'discovery') | 4 | 2.81 MB | 28 Jan 2017 - 14:10 |
| Phantom | 3 | 254.53 KB | 24 Jan 2017 - 06:10 |
| HTMLParser | 2 | 46.23 KB | 02 Jan 2017 - 19:49 |
| LinkChecker | 1+1 | 100 Bytes | 07 Jan 2017 - 05:54 |
| HTTrack off-line browser | 2 | 23.31 MB | 26 Jan 2017 - 15:51 |
| WebFilter | 1+1 | 27.05 KB | 17 Jan 2017 - 21:33 |
| Netcraft | 2 | 17.39 KB | 10 Jan 2017 - 02:49 |
| Google AdSense | 1 | 25.36 KB | 17 Jan 2017 - 11:29 |
| lwp-trivial | 1 | 0 | 23 Jan 2017 - 23:35 |
| GigaBot | 0+1 | 100 Bytes | 02 Jan 2017 - 04:14 |
| MSIECrawler | 1 | 24.95 KB | 14 Jan 2017 - 19:20 |