| 61 different robots | Hits | Bandwidth | Last visit |
|---|
| archive.org bot | 103477+128 | 4.32 GB | 30 Sep 2015 - 23:59 |
| Unknown robot (identified by 'bot*') | 197961+990 | 57.69 GB | 30 Sep 2015 - 23:59 |
| Googlebot | 81666+772 | 119.91 GB | 30 Sep 2015 - 23:59 |
| Yahoo Slurp | 67825+49 | 13.36 GB | 30 Sep 2015 - 23:59 |
| Nagios | 14402 | 122.32 MB | 30 Sep 2015 - 23:59 |
| BaiDuSpider | 55403+16 | 10.44 GB | 30 Sep 2015 - 23:59 |
| Feedfetcher-Google | 3865 | 282.54 MB | 30 Sep 2015 - 23:58 |
| Yandex bot | 12026+274 | 7.75 GB | 30 Sep 2015 - 23:57 |
| Alexa (IA Archiver) | 170+80 | 111.77 MB | 30 Sep 2015 - 23:52 |
| Unknown robot (identified by 'crawl') | 54815+170 | 1.44 GB | 30 Sep 2015 - 23:41 |
| Exabot | 1211+36 | 47.86 MB | 30 Sep 2015 - 23:15 |
| Unknown robot (identified by empty user agent string) | 1583+14 | 1.45 GB | 30 Sep 2015 - 23:13 |
| Unknown robot (identified by 'robot') | 301+139 | 81.39 MB | 30 Sep 2015 - 23:05 |
| Unknown robot (identified by 'spider') | 813+15 | 219.83 MB | 30 Sep 2015 - 22:43 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1178 | 98.93 KB | 30 Sep 2015 - 22:22 |
| Sogou Spider | 5411+133 | 1.00 GB | 30 Sep 2015 - 22:00 |
| FavIconizer | 465 | 131.61 MB | 30 Sep 2015 - 21:48 |
| yacy | 164+7 | 100.02 MB | 30 Sep 2015 - 21:17 |
| Nutch | 6052+95 | 439.55 MB | 30 Sep 2015 - 21:09 |
| Perl tool | 267 | 79.29 MB | 30 Sep 2015 - 20:47 |
| Java (Often spam bot) | 1146+2 | 5.48 GB | 30 Sep 2015 - 20:22 |
| CFNetwork | 459 | 1.00 GB | 30 Sep 2015 - 20:13 |
| Jakarta commons-httpclient | 179 | 1.92 MB | 30 Sep 2015 - 19:09 |
| WordPress | 242 | 21.65 MB | 30 Sep 2015 - 18:40 |
| WebFilter | 9+4 | 118.27 KB | 30 Sep 2015 - 12:36 |
| NewsGator Online | 31 | 4.13 MB | 30 Sep 2015 - 11:19 |
| FaceBook bot | 521 | 10.08 MB | 30 Sep 2015 - 11:02 |
| WGet tools | 99 | 674.03 MB | 30 Sep 2015 - 04:16 |
| MSNBot-media | 104+1 | 46.75 MB | 30 Sep 2015 - 03:34 |
| MSNBot | 9+1 | 19.19 MB | 30 Sep 2015 - 02:47 |
| MJ12bot | 324+27 | 26.97 MB | 29 Sep 2015 - 20:02 |
| BSpider | 33 | 872.29 KB | 29 Sep 2015 - 19:59 |
| SeznamBot | 7+7 | 16.94 MB | 29 Sep 2015 - 14:47 |
| HTTrack off-line browser | 25+1 | 7.17 MB | 28 Sep 2015 - 21:47 |
| Python-urllib | 44+7 | 18.07 MB | 28 Sep 2015 - 19:41 |
| Sift | 44 | 1001.24 KB | 28 Sep 2015 - 19:06 |
| Unknown robot (identified by '*bot') | 1+1 | 86 Bytes | 27 Sep 2015 - 22:46 |
| Harvest | 83 | 17.52 MB | 27 Sep 2015 - 21:19 |
| Phantom | 53 | 7.09 MB | 27 Sep 2015 - 19:36 |
| BetaBot | 5+2 | 122.09 KB | 27 Sep 2015 - 00:18 |
| Google AdSense | 1 | 23.74 KB | 26 Sep 2015 - 03:32 |
| MojeekBot | 2+2 | 25.82 KB | 25 Sep 2015 - 21:27 |
| Unknown robot (identified by 'checker') | 44 | 0 | 25 Sep 2015 - 20:03 |
| WebCollage | 1 | 239.21 KB | 24 Sep 2015 - 17:07 |
| Mail.ru bot | 137+32 | 24.18 MB | 24 Sep 2015 - 13:51 |
| XYLEME Robot | 1 | 27.16 KB | 24 Sep 2015 - 02:20 |
| NG 2.x (Exalead) | 44 | 14.55 MB | 23 Sep 2015 - 08:02 |
| CsCrawler | 1+1 | 8.78 KB | 22 Sep 2015 - 21:31 |
| Heritrix | 3220+4 | 461.03 MB | 20 Sep 2015 - 08:17 |
| Y!J Yahoo Japan | 1+3 | 8.95 KB | 18 Sep 2015 - 02:29 |
| Unknown robot (identified by 'discovery') | 1 | 8.70 KB | 16 Sep 2015 - 05:27 |
| JoBo Java Web Robot | 1 | 6.54 KB | 13 Sep 2015 - 21:01 |
| MSIECrawler | 1 | 720 Bytes | 13 Sep 2015 - 21:01 |
| TITAN | 18 | 3.33 MB | 12 Sep 2015 - 09:42 |
| psbot | 1224+33 | 28.73 MB | 11 Sep 2015 - 05:47 |
| larbin | 7+3 | 116.23 KB | 09 Sep 2015 - 22:15 |
| Netcraft | 1 | 8.70 KB | 08 Sep 2015 - 09:29 |
| LinkChecker | 1+1 | 86 Bytes | 07 Sep 2015 - 07:16 |
| NG 1.x (Exalead) | 19 | 4.16 MB | 06 Sep 2015 - 18:03 |
| Turn It In | 1+1 | 86 Bytes | 05 Sep 2015 - 22:40 |
| Web Core / Roots | 1 | 12.62 KB | 05 Sep 2015 - 02:03 |