66 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 21836+1901 | 6.85 GB | 31 Jul 2012 - 23:59 |
Unknown robot (identified by 'bot*') | 55021+1230 | 56.34 GB | 31 Jul 2012 - 23:59 |
Googlebot | 109638+97 | 53.11 GB | 31 Jul 2012 - 23:59 |
BaiDuSpider | 24356+162 | 3.84 GB | 31 Jul 2012 - 23:59 |
Sogou Spider | 12791+19 | 570.11 MB | 31 Jul 2012 - 23:59 |
Unknown robot (identified by hit on 'robots.txt') | 0+1297 | 39.23 KB | 31 Jul 2012 - 23:59 |
Yandex bot | 32224+67 | 48.09 GB | 31 Jul 2012 - 23:58 |
Exabot | 14134+55 | 9.16 GB | 31 Jul 2012 - 23:56 |
Feedfetcher-Google | 4211 | 41.00 MB | 31 Jul 2012 - 23:53 |
legs | 111320+435 | 121.09 GB | 31 Jul 2012 - 23:53 |
Unknown robot (identified by empty user agent string) | 1828+26 | 4.93 GB | 31 Jul 2012 - 23:29 |
Unknown robot (identified by 'spider') | 1391+97 | 2.14 GB | 31 Jul 2012 - 23:16 |
MJ12bot | 221+109 | 16.02 MB | 31 Jul 2012 - 23:05 |
psbot | 306+24 | 6.29 MB | 31 Jul 2012 - 23:03 |
Unknown robot (identified by '*bot') | 137+457 | 2.90 MB | 31 Jul 2012 - 22:25 |
OutfoxBot/YodaoBot | 294+238 | 2.04 MB | 31 Jul 2012 - 22:13 |
Java (Often spam bot) | 450+5 | 68.75 MB | 31 Jul 2012 - 22:08 |
BSpider | 745+65 | 36.28 MB | 31 Jul 2012 - 21:52 |
Yahoo Slurp | 2814+18 | 115.90 MB | 31 Jul 2012 - 21:49 |
Jakarta commons-httpclient | 100 | 38.78 MB | 31 Jul 2012 - 20:47 |
Alexa (IA Archiver) | 141+132 | 55.48 MB | 31 Jul 2012 - 19:52 |
MSRBOT | 1+4 | 23.25 KB | 31 Jul 2012 - 19:38 |
Unknown robot (identified by 'discovery') | 319+16 | 203.66 MB | 31 Jul 2012 - 18:21 |
WGet tools | 35 | 196.96 MB | 31 Jul 2012 - 17:59 |
Python-urllib | 15+52 | 5.30 MB | 31 Jul 2012 - 15:17 |
MagpieRSS | 0+12 | 372 Bytes | 31 Jul 2012 - 15:04 |
Mail.ru bot | 26+9 | 94.03 MB | 31 Jul 2012 - 14:50 |
MSNBot-media | 1010+478 | 29.49 MB | 31 Jul 2012 - 14:12 |
WordPress | 226 | 33.99 MB | 31 Jul 2012 - 12:35 |
Unknown robot (identified by 'robot') | 353+34 | 842.19 MB | 31 Jul 2012 - 09:46 |
bender focused_crawler | 164+4 | 84.01 MB | 31 Jul 2012 - 06:26 |
DoCoMo | 46+25 | 931.99 KB | 31 Jul 2012 - 05:13 |
CFNetwork | 187 | 196.24 MB | 31 Jul 2012 - 01:13 |
FaceBook bot | 203 | 4.73 MB | 30 Jul 2012 - 23:26 |
Nutch | 476+63 | 375.47 MB | 30 Jul 2012 - 20:42 |
Powermarks | 56 | 28.35 MB | 30 Jul 2012 - 19:53 |
Perl tool | 24 | 1.53 MB | 30 Jul 2012 - 12:46 |
Web Core / Roots | 243 | 116.68 MB | 30 Jul 2012 - 07:01 |
larbin | 1 | 24.18 KB | 30 Jul 2012 - 02:50 |
ichiro | 0+3 | 93 Bytes | 29 Jul 2012 - 19:24 |
archive.org bot | 55+13 | 120.43 MB | 29 Jul 2012 - 19:15 |
Harvest | 45 | 8.54 MB | 29 Jul 2012 - 12:40 |
StackRambler | 1 | 1015.17 KB | 29 Jul 2012 - 08:25 |
Findlinks | 0+17 | 527 Bytes | 29 Jul 2012 - 01:31 |
HTTrack off-line browser | 3 | 26.65 KB | 29 Jul 2012 - 00:27 |
SeznamBot | 50+23 | 1017.98 KB | 28 Jul 2012 - 23:26 |
MSNBot | 128+20 | 14.10 MB | 28 Jul 2012 - 09:32 |
Y!J Yahoo Japan | 6+4 | 651.09 KB | 27 Jul 2012 - 15:21 |
yacy | 407 | 204.03 MB | 26 Jul 2012 - 07:23 |
Checkbot | 4 | 0 | 26 Jul 2012 - 04:14 |
Motor | 11 | 339.77 KB | 25 Jul 2012 - 16:46 |
WebFilter | 3 | 62.47 KB | 25 Jul 2012 - 13:22 |
Unknown robot (identified by 'checker') | 2 | 0 | 24 Jul 2012 - 12:52 |
BBot | 2 | 4.20 MB | 24 Jul 2012 - 08:50 |
LinkChecker | 4+2 | 9.66 KB | 24 Jul 2012 - 08:17 |
Turn It In | 5+5 | 1.47 MB | 24 Jul 2012 - 04:28 |
WebCollage | 1 | 168.22 KB | 20 Jul 2012 - 14:55 |
W3C Validator | 1 | 7.20 MB | 19 Jul 2012 - 05:02 |
Spiderman | 1+1 | 7.02 KB | 19 Jul 2012 - 03:48 |
Custo | 13 | 683.23 KB | 17 Jul 2012 - 13:52 |
NutchCVS | 0+1 | 31 Bytes | 13 Jul 2012 - 10:13 |
Heritrix | 4211+3 | 30.17 MB | 13 Jul 2012 - 08:39 |
FavIconizer | 3 | 20.98 KB | 11 Jul 2012 - 15:15 |
Wild Ferret Web Hopper #1, #2, #3 | 1 | 21.66 KB | 11 Jul 2012 - 03:46 |
JoBo Java Web Robot | 1 | 4.83 KB | 10 Jul 2012 - 05:54 |
Netcraft | 4 | 27.98 KB | 06 Jul 2012 - 13:00 |