59 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 111611+1072 | 54.53 GB | 31 May 2016 - 23:59 |
Googlebot | 99778+828 | 273.68 GB | 31 May 2016 - 23:59 |
BaiDuSpider | 32371+51 | 7.01 GB | 31 May 2016 - 23:59 |
Yandex bot | 69608+158 | 58.39 GB | 31 May 2016 - 23:58 |
Yahoo Slurp | 67144+77 | 14.25 GB | 31 May 2016 - 23:58 |
Nagios | 14883 | 126.41 MB | 31 May 2016 - 23:58 |
Feedfetcher-Google | 2587 | 224.51 MB | 31 May 2016 - 23:51 |
Unknown robot (identified by 'robot') | 8518+203 | 204.23 MB | 31 May 2016 - 23:46 |
BetaBot | 1221+80 | 18.63 MB | 31 May 2016 - 23:44 |
Unknown robot (identified by hit on 'robots.txt') | 0+3748 | 314.77 KB | 31 May 2016 - 23:37 |
Sogou Spider | 1650+100 | 703.97 MB | 31 May 2016 - 23:26 |
Unknown robot (identified by 'crawl') | 145537+344 | 3.72 GB | 31 May 2016 - 23:10 |
MSNBot-media | 161 | 202.75 MB | 31 May 2016 - 22:57 |
Exabot | 1324+29 | 33.31 MB | 31 May 2016 - 22:56 |
Jakarta commons-httpclient | 81 | 18.33 MB | 31 May 2016 - 22:55 |
MJ12bot | 84+8 | 5.67 MB | 31 May 2016 - 22:15 |
Unknown robot (identified by empty user agent string) | 2311+10 | 1.93 GB | 31 May 2016 - 22:02 |
Java (Often spam bot) | 8878+1 | 1.04 GB | 31 May 2016 - 21:08 |
FavIconizer | 415 | 50.10 MB | 31 May 2016 - 20:49 |
Perl tool | 370 | 30.19 MB | 31 May 2016 - 19:55 |
NewsGator Online | 32 | 4.41 MB | 31 May 2016 - 19:38 |
SeznamBot | 16+16 | 222.06 KB | 31 May 2016 - 18:49 |
Pioneer | 191 | 13.20 MB | 31 May 2016 - 17:50 |
Sift | 55 | 1.24 MB | 31 May 2016 - 17:30 |
Unknown robot (identified by 'spider') | 435+13 | 77.67 MB | 31 May 2016 - 17:17 |
WGet tools | 88+2 | 466.27 MB | 31 May 2016 - 16:07 |
Python-urllib | 425+3 | 535.01 MB | 31 May 2016 - 15:36 |
Alexa (IA Archiver) | 449+123 | 112.45 MB | 31 May 2016 - 13:25 |
FaceBook bot | 249 | 9.29 MB | 31 May 2016 - 12:01 |
archive.org bot | 637+98 | 67.15 MB | 31 May 2016 - 09:52 |
CFNetwork | 136 | 1.44 GB | 31 May 2016 - 07:12 |
Unknown robot (identified by 'discovery') | 2 | 50.49 KB | 31 May 2016 - 06:45 |
Web Core / Roots | 5219+2 | 62.27 GB | 31 May 2016 - 00:57 |
MSIECrawler | 1 | 24.45 KB | 30 May 2016 - 05:09 |
Harvest | 222 | 68.50 MB | 29 May 2016 - 17:20 |
SpiderBot | 10+10 | 287.24 KB | 29 May 2016 - 09:24 |
HTTrack off-line browser | 178+2 | 12.13 MB | 29 May 2016 - 02:28 |
Unknown robot (identified by 'sucker') | 3 | 80.57 KB | 28 May 2016 - 13:04 |
Unknown robot (identified by 'checker') | 48 | 0 | 27 May 2016 - 21:58 |
Unknown robot (identified by '*bot') | 5+1 | 8.42 MB | 26 May 2016 - 08:51 |
WordPress | 127 | 8.80 MB | 26 May 2016 - 06:19 |
yacy | 94+5 | 32.21 MB | 26 May 2016 - 01:23 |
Nutch | 63+24 | 141.69 MB | 24 May 2016 - 03:59 |
Phantom | 1 | 101.80 KB | 23 May 2016 - 23:19 |
Heritrix | 67+4 | 26.85 MB | 23 May 2016 - 13:03 |
TITAN | 2 | 1016.80 KB | 22 May 2016 - 14:16 |
Speedy Spider | 2+2 | 17.56 KB | 19 May 2016 - 16:50 |
WebCollage | 1 | 28.94 KB | 15 May 2016 - 20:48 |
Mail.ru bot | 1403+60 | 1.29 GB | 15 May 2016 - 10:37 |
WebFilter | 10+1 | 296.53 KB | 14 May 2016 - 03:52 |
Custo | 1 | 24.19 KB | 10 May 2016 - 15:21 |
Netcraft | 1 | 8.70 KB | 10 May 2016 - 10:49 |
NG 1.x (Exalead) | 2 | 61.27 KB | 08 May 2016 - 19:15 |
W3C Validator | 1 | 41.01 MB | 08 May 2016 - 19:06 |
LinkChecker | 1+1 | 86 Bytes | 07 May 2016 - 07:58 |
Sunrise | 1 | 4.49 KB | 05 May 2016 - 09:28 |
Google AdSense | 1 | 24.84 KB | 03 May 2016 - 20:17 |
StackRambler | 20 | 1.28 MB | 02 May 2016 - 04:13 |
MojeekBot | 1+2 | 8.87 KB | 01 May 2016 - 05:45 |