58 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 135873+2912 | 78.06 GB | 30 Nov 2015 - 23:59 |
Unknown robot (identified by empty user agent string) | 4303+6 | 517.25 MB | 30 Nov 2015 - 23:59 |
BaiDuSpider | 46528 | 12.88 GB | 30 Nov 2015 - 23:59 |
Yahoo Slurp | 71408+41 | 13.54 GB | 30 Nov 2015 - 23:58 |
Googlebot | 63597+755 | 94.56 GB | 30 Nov 2015 - 23:58 |
Nagios | 14422 | 122.49 MB | 30 Nov 2015 - 23:58 |
Yandex bot | 31085+132 | 41.65 GB | 30 Nov 2015 - 23:53 |
Mail.ru bot | 1309+63 | 274.45 MB | 30 Nov 2015 - 23:52 |
Exabot | 1557+30 | 68.75 MB | 30 Nov 2015 - 23:45 |
Feedfetcher-Google | 3851 | 279.18 MB | 30 Nov 2015 - 23:38 |
Unknown robot (identified by hit on 'robots.txt') | 0+2252 | 189.13 KB | 30 Nov 2015 - 23:31 |
Unknown robot (identified by 'crawl') | 22074+240 | 857.79 MB | 30 Nov 2015 - 23:31 |
Sogou Spider | 4873+177 | 980.97 MB | 30 Nov 2015 - 23:27 |
Unknown robot (identified by 'robot') | 249+149 | 61.87 MB | 30 Nov 2015 - 23:16 |
FavIconizer | 491 | 414.46 MB | 30 Nov 2015 - 22:24 |
Perl tool | 383 | 57.83 MB | 30 Nov 2015 - 22:05 |
TITAN | 8 | 37.60 MB | 30 Nov 2015 - 21:40 |
MSNBot-media | 53 | 81.09 MB | 30 Nov 2015 - 20:05 |
Heritrix | 108+6 | 139.34 MB | 30 Nov 2015 - 19:38 |
Java (Often spam bot) | 1348+2 | 1.09 GB | 30 Nov 2015 - 19:33 |
MJ12bot | 532+19 | 13.45 MB | 30 Nov 2015 - 18:06 |
Python-urllib | 3274+7 | 75.26 MB | 30 Nov 2015 - 18:06 |
NewsGator Online | 30 | 4.06 MB | 30 Nov 2015 - 17:54 |
SeznamBot | 23+20 | 73.72 KB | 30 Nov 2015 - 16:27 |
Jakarta commons-httpclient | 207 | 3.00 MB | 30 Nov 2015 - 16:05 |
Alexa (IA Archiver) | 190+93 | 93.58 MB | 30 Nov 2015 - 15:55 |
CFNetwork | 221 | 615.95 MB | 30 Nov 2015 - 14:53 |
Unknown robot (identified by 'spider') | 338+20 | 96.99 MB | 30 Nov 2015 - 14:06 |
WordPress | 225 | 18.94 MB | 30 Nov 2015 - 13:51 |
Google AdSense | 3 | 70.71 KB | 30 Nov 2015 - 13:51 |
FaceBook bot | 261 | 5.90 MB | 30 Nov 2015 - 08:59 |
WGet tools | 892+2 | 1.93 GB | 30 Nov 2015 - 04:51 |
Nutch | 30+30 | 529.76 KB | 30 Nov 2015 - 03:30 |
SpiderBot | 4+4 | 9.71 MB | 29 Nov 2015 - 13:27 |
Sift | 43 | 997.50 KB | 28 Nov 2015 - 20:25 |
yacy | 178+11 | 97.07 MB | 28 Nov 2015 - 12:21 |
HTTrack off-line browser | 3 | 51.78 MB | 28 Nov 2015 - 03:00 |
LinkChecker | 2+2 | 172 Bytes | 27 Nov 2015 - 23:10 |
Unknown robot (identified by 'checker') | 40 | 0 | 27 Nov 2015 - 20:07 |
Unknown robot (identified by 'discovery') | 6 | 63.33 KB | 27 Nov 2015 - 01:53 |
archive.org bot | 12140+39 | 74.05 MB | 27 Nov 2015 - 00:44 |
Powermarks | 1 | 8.70 KB | 25 Nov 2015 - 20:28 |
WallPaper (alias crawlpaper) | 1 | 30.87 KB | 25 Nov 2015 - 12:16 |
Phantom | 3 | 3.43 MB | 25 Nov 2015 - 01:16 |
CsCrawler | 1+1 | 8.78 KB | 24 Nov 2015 - 23:11 |
Harvest | 20 | 312.90 KB | 24 Nov 2015 - 20:46 |
NG 2.x (Exalead) | 40 | 7.32 MB | 24 Nov 2015 - 04:54 |
MSNBot | 7 | 125.48 KB | 23 Nov 2015 - 02:53 |
WebCollage | 1 | 305.67 KB | 21 Nov 2015 - 21:21 |
Y!J Yahoo Japan | 7+4 | 80.49 KB | 21 Nov 2015 - 11:07 |
BetaBot | 83+3 | 10.18 MB | 20 Nov 2015 - 10:32 |
MSIECrawler | 1 | 8.85 KB | 18 Nov 2015 - 10:20 |
psbot | 916+28 | 21.30 MB | 16 Nov 2015 - 09:17 |
WebFilter | 5+3 | 59.58 KB | 13 Nov 2015 - 02:43 |
MojeekBot | 2+2 | 52.91 KB | 10 Nov 2015 - 22:12 |
Unknown robot (identified by '*bot') | 5+1 | 86 Bytes | 09 Nov 2015 - 04:16 |
Netcraft | 1 | 8.70 KB | 07 Nov 2015 - 01:58 |
Web Core / Roots | 1+3 | 24.11 KB | 05 Nov 2015 - 03:23 |