56 different robots | Hits | Bandwidth | Last visit |
Googlebot | 87274+803 | 188.14 GB | 31 Jan 2017 - 23:59 |
Yandex bot | 37571+129 | 20.16 GB | 31 Jan 2017 - 23:59 |
Sogou Spider | 20435+691 | 2.15 GB | 31 Jan 2017 - 23:59 |
Unknown robot (identified by 'bot*') | 74490+651 | 18.33 GB | 31 Jan 2017 - 23:59 |
Nagios | 14883 | 126.41 MB | 31 Jan 2017 - 23:59 |
Unknown robot (identified by empty user agent string) | 1716+13 | 1.49 GB | 31 Jan 2017 - 23:59 |
BaiDuSpider | 50221+21 | 6.00 GB | 31 Jan 2017 - 23:59 |
Yahoo Slurp | 54598+48 | 5.96 GB | 31 Jan 2017 - 23:59 |
Unknown robot (identified by hit on 'robots.txt') | 0+3754 | 366.60 KB | 31 Jan 2017 - 23:50 |
Feedfetcher-Google | 1386 | 178.26 MB | 31 Jan 2017 - 23:47 |
MJ12bot | 70+58 | 1.61 MB | 31 Jan 2017 - 23:35 |
FaceBook bot | 220 | 10.15 MB | 31 Jan 2017 - 23:31 |
Perl tool | 335 | 34.98 MB | 31 Jan 2017 - 23:05 |
SeznamBot | 116+115 | 646.47 KB | 31 Jan 2017 - 23:02 |
Unknown robot (identified by 'crawl') | 14615+130 | 623.40 MB | 31 Jan 2017 - 22:25 |
FavIconizer | 367 | 99.25 MB | 31 Jan 2017 - 22:16 |
CFNetwork | 287 | 500.34 MB | 31 Jan 2017 - 22:16 |
Exabot | 13133+29 | 971.89 MB | 31 Jan 2017 - 22:06 |
Java (Often spam bot) | 3485+1 | 23.23 GB | 31 Jan 2017 - 22:05 |
Python-urllib | 28221+2 | 848.32 MB | 31 Jan 2017 - 18:39 |
Unknown robot (identified by 'robot') | 201+151 | 48.24 MB | 31 Jan 2017 - 17:26 |
NewsGator Online | 32 | 4.51 MB | 31 Jan 2017 - 13:50 |
Sift | 45 | 993.94 KB | 31 Jan 2017 - 12:58 |
Jakarta commons-httpclient | 76 | 3.59 MB | 31 Jan 2017 - 12:52 |
Unknown robot (identified by 'spider') | 160+8 | 137.90 MB | 31 Jan 2017 - 11:20 |
Alexa (IA Archiver) | 77+53 | 68.97 MB | 31 Jan 2017 - 09:56 |
WGet tools | 6289+1 | 81.43 GB | 31 Jan 2017 - 08:20 |
archive.org bot | 51+19 | 16.44 MB | 31 Jan 2017 - 07:31 |
Unknown robot (identified by '*bot') | 91+11 | 46.73 MB | 30 Jan 2017 - 22:54 |
Web Core / Roots | 9047 | 127.00 MB | 30 Jan 2017 - 20:44 |
MSNBot-media | 648 | 336.50 MB | 30 Jan 2017 - 14:43 |
yacy | 546+18 | 233.27 MB | 30 Jan 2017 - 07:55 |
WordPress | 41 | 0 | 29 Jan 2017 - 19:55 |
Nutch | 197+22 | 22.05 MB | 29 Jan 2017 - 11:21 |
Harvest | 37 | 994.60 KB | 28 Jan 2017 - 19:50 |
Unknown robot (identified by 'discovery') | 4 | 2.81 MB | 28 Jan 2017 - 14:10 |
Unknown robot (identified by 'checker') | 424 | 12.40 MB | 28 Jan 2017 - 09:01 |
MojeekBot | 4+5 | 85.74 KB | 27 Jan 2017 - 09:21 |
HTTrack off-line browser | 2 | 23.31 MB | 26 Jan 2017 - 15:51 |
Turn It In | 11+6 | 588.26 KB | 26 Jan 2017 - 07:12 |
NG 1.x (Exalead) | 5 | 10.65 MB | 24 Jan 2017 - 21:37 |
Phantom | 3 | 254.53 KB | 24 Jan 2017 - 06:10 |
LinkBot | 10 | 236.30 KB | 24 Jan 2017 - 01:28 |
lwp-trivial | 1 | 0 | 23 Jan 2017 - 23:35 |
UniversalFeedParser | 7 | 0 | 23 Jan 2017 - 11:24 |
WebFilter | 1+1 | 27.05 KB | 17 Jan 2017 - 21:33 |
Google AdSense | 1 | 25.36 KB | 17 Jan 2017 - 11:29 |
MSIECrawler | 1 | 24.95 KB | 14 Jan 2017 - 19:20 |
W3C Link Checker | 3+3 | 300 Bytes | 13 Jan 2017 - 10:00 |
psbot | 20+1 | 526.44 KB | 10 Jan 2017 - 08:25 |
Netcraft | 2 | 17.39 KB | 10 Jan 2017 - 02:49 |
LinkChecker | 1+1 | 100 Bytes | 07 Jan 2017 - 05:54 |
Custo | 15 | 2.17 MB | 06 Jan 2017 - 19:14 |
arks | 19 | 39.52 MB | 06 Jan 2017 - 12:21 |
HTMLParser | 2 | 46.23 KB | 02 Jan 2017 - 19:49 |
GigaBot | 0+1 | 100 Bytes | 02 Jan 2017 - 04:14 |