63 different robots | Hits | Bandwidth | Last visit |
Googlebot | 105441+717 | 135.25 GB | 30 Sep 2013 - 23:59 |
Unknown robot (identified by 'spider') | 7786+120 | 892.37 MB | 30 Sep 2013 - 23:58 |
BaiDuSpider | 7155+39 | 592.09 MB | 30 Sep 2013 - 23:58 |
Unknown robot (identified by 'bot*') | 127573+311 | 18.47 GB | 30 Sep 2013 - 23:58 |
Unknown robot (identified by empty user agent string) | 2901+3 | 1.41 GB | 30 Sep 2013 - 23:53 |
Yandex bot | 8252+80 | 6.73 GB | 30 Sep 2013 - 23:45 |
SeznamBot | 164+26 | 4.60 MB | 30 Sep 2013 - 23:44 |
Feedfetcher-Google | 3868 | 308.00 MB | 30 Sep 2013 - 23:38 |
Unknown robot (identified by 'checker') | 161 | 0 | 30 Sep 2013 - 23:35 |
Nutch | 12461+30 | 239.99 MB | 30 Sep 2013 - 23:32 |
Sogou Spider | 10686+247 | 4.46 GB | 30 Sep 2013 - 23:25 |
Unknown robot (identified by hit on 'robots.txt') | 0+599 | 50.31 KB | 30 Sep 2013 - 22:57 |
Unknown robot (identified by 'crawl') | 95+40 | 8.89 MB | 30 Sep 2013 - 22:34 |
Unknown robot (identified by '*bot') | 256+167 | 6.88 MB | 30 Sep 2013 - 22:32 |
psbot | 132+26 | 3.06 MB | 30 Sep 2013 - 20:34 |
BSpider | 184 | 368.69 MB | 30 Sep 2013 - 20:28 |
Jakarta commons-httpclient | 235 | 11.94 MB | 30 Sep 2013 - 20:19 |
Java (Often spam bot) | 975 | 1.90 GB | 30 Sep 2013 - 20:15 |
DoCoMo | 140+4 | 3.50 MB | 30 Sep 2013 - 18:49 |
MSNBot-media | 126+214 | 77.98 MB | 30 Sep 2013 - 18:27 |
MSNBot | 306+45 | 8.77 MB | 30 Sep 2013 - 18:25 |
Yahoo Slurp | 1329+7 | 91.39 MB | 30 Sep 2013 - 18:23 |
WordPress | 168 | 8.35 MB | 30 Sep 2013 - 18:08 |
CFNetwork | 563 | 586.80 MB | 30 Sep 2013 - 16:44 |
FaceBook bot | 394 | 18.57 MB | 30 Sep 2013 - 13:45 |
Mail.ru bot | 3481+32 | 2.67 GB | 30 Sep 2013 - 12:54 |
WGet tools | 61+1 | 195.73 MB | 30 Sep 2013 - 10:32 |
Web Core / Roots | 10 | 2.07 MB | 30 Sep 2013 - 08:10 |
Unknown robot (identified by 'robot') | 703+13 | 27.60 MB | 30 Sep 2013 - 08:04 |
MagpieRSS | 1+29 | 23.44 KB | 30 Sep 2013 - 07:19 |
Alexa (IA Archiver) | 48+57 | 21.78 MB | 30 Sep 2013 - 03:01 |
Harvest | 116 | 1.51 MB | 30 Sep 2013 - 02:23 |
Exabot | 310+29 | 14.21 MB | 30 Sep 2013 - 02:03 |
arks | 14 | 15.10 MB | 30 Sep 2013 - 01:50 |
Python-urllib | 8+86 | 10.86 MB | 29 Sep 2013 - 20:21 |
WebFilter | 95+23 | 1.35 MB | 29 Sep 2013 - 17:03 |
Perl tool | 27 | 39.65 MB | 29 Sep 2013 - 05:56 |
TITAN | 6 | 1.03 MB | 29 Sep 2013 - 00:19 |
WebCollage | 17 | 3.16 MB | 28 Sep 2013 - 22:34 |
archive.org bot | 3+4 | 57.95 KB | 28 Sep 2013 - 10:16 |
ichiro | 62+18 | 1.09 MB | 28 Sep 2013 - 06:50 |
NG 2.x (Exalead) | 15 | 194.84 KB | 28 Sep 2013 - 05:54 |
Heritrix | 655+11 | 102.25 MB | 28 Sep 2013 - 03:08 |
MJ12bot | 144+40 | 4.46 MB | 27 Sep 2013 - 23:08 |
yacy | 1+2 | 3.04 MB | 27 Sep 2013 - 12:41 |
legs | 45+47 | 1.46 MB | 27 Sep 2013 - 08:07 |
Checkbot | 6 | 0 | 26 Sep 2013 - 04:08 |
NG 1.x (Exalead) | 17 | 2.67 MB | 24 Sep 2013 - 11:16 |
Unknown robot (identified by 'discovery') | 7 | 16.82 KB | 24 Sep 2013 - 07:15 |
Turn It In | 1+1 | 24.10 KB | 24 Sep 2013 - 00:47 |
MSIECrawler | 2 | 711.22 KB | 23 Sep 2013 - 01:15 |
Fish search | 3 | 7.69 MB | 19 Sep 2013 - 06:45 |
Findlinks | 1+2 | 9.84 KB | 18 Sep 2013 - 14:26 |
Combine System | 1+1 | 8.49 KB | 18 Sep 2013 - 13:21 |
FavIconizer | 2 | 16.82 KB | 17 Sep 2013 - 10:50 |
WallPaper (alias crawlpaper) | 1 | 36.05 KB | 13 Sep 2013 - 13:44 |
HTTrack off-line browser | 12+1 | 1.04 MB | 12 Sep 2013 - 06:58 |
Speedy Spider | 10+8 | 275.72 KB | 10 Sep 2013 - 02:41 |
Netcraft | 1 | 8.41 KB | 09 Sep 2013 - 09:48 |
Powermarks | 3 | 38.55 KB | 08 Sep 2013 - 04:14 |
Unknown robot (identified by 'sucker') | 1 | 26.45 KB | 07 Sep 2013 - 23:36 |
Phantom | 5 | 1.65 MB | 07 Sep 2013 - 07:28 |
LinkChecker | 2 | 26.45 KB | 02 Sep 2013 - 06:51 |