| 56 different robots | Hits | Bandwidth | Last visit |
|---|
| Mail.ru bot | 226+67 | 45.45 MB | 31 Mar 2016 - 23:59 |
| Yahoo Slurp | 72144+572 | 19.11 GB | 31 Mar 2016 - 23:59 |
| Unknown robot (identified by 'bot*') | 133167+888 | 64.89 GB | 31 Mar 2016 - 23:59 |
| BaiDuSpider | 36574+38 | 6.93 GB | 31 Mar 2016 - 23:59 |
| Nagios | 14859 | 126.20 MB | 31 Mar 2016 - 23:57 |
| Googlebot | 108284+1105 | 235.22 GB | 31 Mar 2016 - 23:55 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1979 | 166.21 KB | 31 Mar 2016 - 23:50 |
| Feedfetcher-Google | 2522 | 219.44 MB | 31 Mar 2016 - 23:49 |
| Sogou Spider | 5701+132 | 1.37 GB | 31 Mar 2016 - 23:47 |
| Alexa (IA Archiver) | 470+106 | 95.06 MB | 31 Mar 2016 - 23:41 |
| Unknown robot (identified by empty user agent string) | 5901+11 | 9.44 GB | 31 Mar 2016 - 23:36 |
| Yandex bot | 56855+135 | 91.25 GB | 31 Mar 2016 - 23:36 |
| MSNBot-media | 158 | 102.91 MB | 31 Mar 2016 - 23:25 |
| MJ12bot | 31+17 | 2.67 MB | 31 Mar 2016 - 22:56 |
| Perl tool | 369 | 46.49 MB | 31 Mar 2016 - 22:53 |
| Unknown robot (identified by 'robot') | 296+182 | 21.36 MB | 31 Mar 2016 - 22:42 |
| Exabot | 1607+31 | 41.31 MB | 31 Mar 2016 - 22:35 |
| FaceBook bot | 552 | 355.51 MB | 31 Mar 2016 - 22:11 |
| Unknown robot (identified by 'crawl') | 9632+197 | 314.99 MB | 31 Mar 2016 - 21:55 |
| Java (Often spam bot) | 7181+12 | 243.71 MB | 31 Mar 2016 - 21:35 |
| Python-urllib | 615+4 | 789.20 MB | 31 Mar 2016 - 21:31 |
| archive.org bot | 304+90 | 400.62 MB | 31 Mar 2016 - 20:58 |
| WebFilter | 36+5 | 546.33 KB | 31 Mar 2016 - 19:47 |
| SeznamBot | 30+30 | 3.27 MB | 31 Mar 2016 - 18:44 |
| CFNetwork | 199 | 692.97 MB | 31 Mar 2016 - 18:25 |
| Unknown robot (identified by 'spider') | 474+17 | 98.00 MB | 31 Mar 2016 - 17:45 |
| Sift | 45 | 1.04 MB | 31 Mar 2016 - 17:02 |
| Jakarta commons-httpclient | 125+2 | 2.57 MB | 31 Mar 2016 - 16:00 |
| FavIconizer | 385 | 19.91 MB | 31 Mar 2016 - 14:27 |
| yacy | 262+8 | 89.87 MB | 31 Mar 2016 - 13:05 |
| NewsGator Online | 32 | 4.41 MB | 31 Mar 2016 - 11:41 |
| Speedy Spider | 3+3 | 24.41 KB | 31 Mar 2016 - 01:32 |
| Harvest | 28 | 809.62 KB | 30 Mar 2016 - 17:23 |
| Nutch | 106+41 | 39.43 MB | 30 Mar 2016 - 14:52 |
| BetaBot | 4209+195 | 42.70 MB | 30 Mar 2016 - 01:23 |
| LinkChecker | 11+11 | 946 Bytes | 30 Mar 2016 - 00:26 |
| XYLEME Robot | 1 | 21.00 KB | 29 Mar 2016 - 21:44 |
| HTTrack off-line browser | 38+2 | 24.00 MB | 29 Mar 2016 - 18:39 |
| WGet tools | 28 | 144.25 MB | 29 Mar 2016 - 12:20 |
| Unknown robot (identified by 'discovery') | 8 | 85.85 KB | 29 Mar 2016 - 08:20 |
| psbot | 668+29 | 13.24 MB | 29 Mar 2016 - 00:16 |
| Pioneer | 55 | 3.93 MB | 28 Mar 2016 - 18:12 |
| Powermarks | 1 | 24.95 KB | 28 Mar 2016 - 11:16 |
| WordPress | 221 | 104.27 MB | 27 Mar 2016 - 22:34 |
| Phantom | 55 | 10.31 MB | 27 Mar 2016 - 05:30 |
| Unknown robot (identified by 'checker') | 44 | 0 | 25 Mar 2016 - 22:38 |
| Turn It In | 27+7 | 166.22 KB | 21 Mar 2016 - 23:45 |
| Google AdSense | 7 | 182.28 KB | 21 Mar 2016 - 06:01 |
| WebCollage | 1 | 9.91 KB | 20 Mar 2016 - 18:26 |
| SpiderBot | 6+6 | 133.23 KB | 19 Mar 2016 - 13:01 |
| WebMiner | 1 | 8.70 KB | 15 Mar 2016 - 17:47 |
| Heritrix | 73+7 | 54.39 MB | 14 Mar 2016 - 20:43 |
| Web Core / Roots | 1 | 23.86 KB | 14 Mar 2016 - 07:14 |
| Netcraft | 1 | 8.70 KB | 08 Mar 2016 - 09:10 |
| TITAN | 2 | 66.82 KB | 08 Mar 2016 - 05:42 |
| Unknown robot (identified by '*bot') | 1 | 0 | 01 Mar 2016 - 12:58 |