54 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 129651+1200 | 38.78 GB | 31 Aug 2016 - 23:59 |
Googlebot | 96436+838 | 166.74 GB | 31 Aug 2016 - 23:59 |
Yahoo Slurp | 55965+70 | 8.34 GB | 31 Aug 2016 - 23:58 |
BaiDuSpider | 53035+18 | 11.31 GB | 31 Aug 2016 - 23:59 |
Unknown robot (identified by 'crawl') | 17058+185 | 5.44 GB | 31 Aug 2016 - 22:38 |
Yandex bot | 15773+113 | 20.14 GB | 31 Aug 2016 - 23:54 |
Nagios | 14894 | 126.50 MB | 31 Aug 2016 - 23:59 |
WGet tools | 9225+8 | 548.08 MB | 31 Aug 2016 - 16:52 |
UniversalFeedParser | 5699 | 26.41 MB | 31 Aug 2016 - 10:17 |
Sogou Spider | 5261+248 | 2.12 GB | 31 Aug 2016 - 22:32 |
Unknown robot (identified by hit on 'robots.txt') | 0+3928 | 329.89 KB | 31 Aug 2016 - 21:38 |
Web Core / Roots | 3064+1 | 30.18 GB | 31 Aug 2016 - 23:19 |
psbot | 2976+83 | 69.57 MB | 31 Aug 2016 - 23:45 |
Heritrix | 2995+5 | 33.62 MB | 28 Aug 2016 - 22:43 |
Exabot | 2676+26 | 98.42 MB | 31 Aug 2016 - 11:57 |
Feedfetcher-Google | 1736 | 134.63 MB | 31 Aug 2016 - 23:32 |
Unknown robot (identified by empty user agent string) | 1210+14 | 283.57 MB | 31 Aug 2016 - 23:53 |
Python-urllib | 921 | 488.39 MB | 31 Aug 2016 - 13:17 |
Java (Often spam bot) | 745+6 | 919.92 MB | 31 Aug 2016 - 21:36 |
Unknown robot (identified by 'spider') | 652+26 | 68.01 MB | 31 Aug 2016 - 17:45 |
MSNBot-media | 569 | 172.16 MB | 31 Aug 2016 - 22:28 |
FaceBook bot | 531 | 21.13 MB | 31 Aug 2016 - 20:44 |
FavIconizer | 451 | 105.93 MB | 31 Aug 2016 - 23:23 |
Unknown robot (identified by 'robot') | 245+177 | 112.40 MB | 31 Aug 2016 - 20:00 |
Alexa (IA Archiver) | 230+125 | 64.15 MB | 31 Aug 2016 - 23:44 |
CFNetwork | 353 | 1.23 GB | 31 Aug 2016 - 15:28 |
Perl tool | 337 | 42.11 MB | 31 Aug 2016 - 19:28 |
archive.org bot | 186+28 | 109.16 MB | 31 Aug 2016 - 18:52 |
legs | 206+5 | 4.28 MB | 28 Aug 2016 - 14:25 |
SeznamBot | 110+90 | 646.10 KB | 31 Aug 2016 - 22:58 |
Harvest | 131 | 35.59 MB | 29 Aug 2016 - 08:18 |
MJ12bot | 107+20 | 7.84 MB | 31 Aug 2016 - 16:34 |
Jakarta commons-httpclient | 91 | 17.41 MB | 31 Aug 2016 - 22:25 |
Unknown robot (identified by 'checker') | 91 | 0 | 27 Aug 2016 - 16:18 |
yacy | 35+31 | 124.20 MB | 29 Aug 2016 - 06:00 |
Sift | 52 | 1.13 MB | 31 Aug 2016 - 05:54 |
WordPress | 51 | 504.81 KB | 30 Aug 2016 - 07:49 |
Turn It In | 20+15 | 18.61 MB | 30 Aug 2016 - 21:56 |
NewsGator Online | 32 | 4.41 MB | 31 Aug 2016 - 05:34 |
Nutch | 9+14 | 3.83 MB | 27 Aug 2016 - 20:19 |
TITAN | 22 | 62.05 MB | 20 Aug 2016 - 10:47 |
Custo | 19 | 6.47 MB | 08 Aug 2016 - 20:54 |
Phantom | 10 | 2.58 MB | 22 Aug 2016 - 22:05 |
WebFilter | 5+5 | 58.47 KB | 20 Aug 2016 - 02:06 |
Unknown robot (identified by 'discovery') | 5 | 3.07 MB | 25 Aug 2016 - 05:04 |
HTMLParser | 3 | 26.09 KB | 24 Aug 2016 - 01:36 |
LinkChecker | 1+1 | 86 Bytes | 07 Aug 2016 - 07:34 |
MojeekBot | 1+1 | 23.06 KB | 09 Aug 2016 - 15:25 |
HTTrack off-line browser | 2 | 2.06 MB | 15 Aug 2016 - 02:05 |
Unknown robot (identified by '*bot') | 1 | 0 | 02 Aug 2016 - 16:53 |
MSNBot | 1 | 606.64 KB | 05 Aug 2016 - 02:52 |
NG 1.x (Exalead) | 1 | 24.95 KB | 23 Aug 2016 - 13:16 |
MagpieRSS | 1 | 29.71 KB | 21 Aug 2016 - 01:03 |
Netcraft | 1 | 8.70 KB | 09 Aug 2016 - 20:22 |