64 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 153764+885 | 16.70 GB | 31 Dec 2014 - 23:57 |
Unknown robot (identified by 'crawl') | 109136+373 | 1.35 GB | 31 Dec 2014 - 22:30 |
Googlebot | 102214+742 | 125.74 GB | 31 Dec 2014 - 23:59 |
Yandex bot | 55014+69 | 52.21 GB | 31 Dec 2014 - 23:57 |
Yahoo Slurp | 48577+66 | 17.21 GB | 31 Dec 2014 - 23:57 |
Unknown robot (identified by empty user agent string) | 38292 | 339.99 GB | 31 Dec 2014 - 23:44 |
BaiDuSpider | 28303+79 | 18.73 GB | 31 Dec 2014 - 23:58 |
Nagios | 14886 | 126.43 MB | 31 Dec 2014 - 23:58 |
Sogou Spider | 4067+105 | 1.06 GB | 31 Dec 2014 - 20:52 |
Feedfetcher-Google | 3429 | 273.47 MB | 31 Dec 2014 - 23:52 |
Heritrix | 2994+4 | 102.85 MB | 18 Dec 2014 - 04:59 |
Java (Often spam bot) | 1406+5 | 5.38 GB | 31 Dec 2014 - 21:57 |
Unknown robot (identified by 'spider') | 1181+36 | 94.58 MB | 31 Dec 2014 - 22:56 |
larbin | 1136+18 | 39.48 MB | 31 Dec 2014 - 17:28 |
Exabot | 695+41 | 29.34 MB | 31 Dec 2014 - 20:19 |
Unknown robot (identified by hit on 'robots.txt') | 0+684 | 57.45 KB | 31 Dec 2014 - 17:58 |
FaceBook bot | 638 | 11.01 MB | 30 Dec 2014 - 12:58 |
Unknown robot (identified by 'robot') | 441+63 | 54.24 MB | 31 Dec 2014 - 23:47 |
MJ12bot | 334+57 | 26.46 MB | 31 Dec 2014 - 05:59 |
Python-urllib | 284+8 | 43.13 MB | 31 Dec 2014 - 03:09 |
FavIconizer | 276 | 58.56 MB | 31 Dec 2014 - 21:45 |
WordPress | 230 | 25.74 MB | 29 Dec 2014 - 17:00 |
Alexa (IA Archiver) | 160+61 | 19.95 MB | 31 Dec 2014 - 11:56 |
CFNetwork | 190 | 232.55 MB | 30 Dec 2014 - 16:54 |
Perl tool | 161 | 23.03 MB | 31 Dec 2014 - 21:03 |
WebFilter | 109+37 | 1.60 MB | 30 Dec 2014 - 11:35 |
SeznamBot | 67+52 | 17.08 MB | 31 Dec 2014 - 13:28 |
Jakarta commons-httpclient | 98+11 | 31.15 MB | 31 Dec 2014 - 09:11 |
yacy | 97+9 | 28.14 MB | 31 Dec 2014 - 06:24 |
Nutch | 56+46 | 694.17 KB | 30 Dec 2014 - 19:52 |
archive.org bot | 76+16 | 36.42 MB | 30 Dec 2014 - 20:19 |
HTTrack off-line browser | 63+11 | 16.18 MB | 31 Dec 2014 - 17:32 |
TITAN | 57 | 4.53 MB | 18 Dec 2014 - 01:05 |
Sift | 54 | 1.20 MB | 31 Dec 2014 - 15:24 |
Pioneer | 41 | 1.41 MB | 29 Dec 2014 - 00:01 |
Harvest | 35 | 4.63 MB | 27 Dec 2014 - 19:05 |
Unknown robot (identified by 'checker') | 34 | 8.70 KB | 26 Dec 2014 - 18:08 |
NewsGator Online | 31 | 3.95 MB | 31 Dec 2014 - 11:25 |
Unknown robot (identified by 'discovery') | 26 | 2.19 MB | 27 Dec 2014 - 13:35 |
arks | 20 | 8.14 MB | 27 Dec 2014 - 11:55 |
WGet tools | 18 | 113.17 MB | 29 Dec 2014 - 16:29 |
DoCoMo | 9+4 | 56.42 KB | 26 Dec 2014 - 12:30 |
Phantom | 10 | 12.29 KB | 18 Dec 2014 - 19:15 |
SpiderBot | 3+3 | 10.00 MB | 26 Dec 2014 - 21:56 |
Unknown robot (identified by '*bot') | 6 | 52.95 KB | 29 Dec 2014 - 17:14 |
NG 1.x (Exalead) | 4 | 13.32 MB | 28 Dec 2014 - 10:05 |
Checkbot | 4 | 0 | 25 Dec 2014 - 03:34 |
Google AdSense | 4 | 91.49 KB | 10 Dec 2014 - 11:24 |
Digger | 1+2 | 27.02 KB | 28 Dec 2014 - 00:49 |
lwp-request | 3 | 27.25 MB | 09 Dec 2014 - 19:00 |
VORTEX | 3 | 15.37 KB | 09 Dec 2014 - 12:48 |
Raven Search | 2 | 0 | 02 Dec 2014 - 20:04 |
BBot | 2 | 6.24 MB | 17 Dec 2014 - 03:19 |
MSNBot | 2 | 932.05 KB | 23 Dec 2014 - 16:46 |
LinkChecker | 1+1 | 86 Bytes | 07 Dec 2014 - 06:24 |
MojeekBot | 1+1 | 8.78 KB | 06 Dec 2014 - 05:24 |
Speedy Spider | 1+1 | 8.78 KB | 01 Dec 2014 - 09:48 |
Mail.ru bot | 1 | 8.70 KB | 22 Dec 2014 - 22:28 |
Web Core / Roots | 1 | 28.75 KB | 27 Dec 2014 - 21:05 |
WebCollage | 1 | 16.75 KB | 28 Dec 2014 - 16:17 |
BetaBot | 1 | 20.01 KB | 09 Dec 2014 - 15:06 |
StackRambler | 1 | 494.04 KB | 15 Dec 2014 - 06:32 |
Netcraft | 1 | 8.70 KB | 10 Dec 2014 - 05:45 |
WallPaper (alias crawlpaper) | 1 | 30.87 KB | 13 Dec 2014 - 05:45 |