Statistics for: thesis.library.caltech.eduAwstats Web Site
Last Update: 05 Jun 2011 - 12:47
Reported period:Month May 2011
Close window
 
Robots/Spiders visitors  
66 different robotsHitsBandwidthLast visit
Googlebot72683+9542.15 GB31 May 2011 - 22:19
Yahoo Slurp31946+2268.52 GB31 May 2011 - 23:55
Unknown robot (identified by 'crawl')31495+3498.19 GB31 May 2011 - 12:03
Unknown robot (identified by 'bot*')12547+9472.32 GB31 May 2011 - 21:00
Unknown robot (identified by 'discovery')3966+572150.78 MB29 May 2011 - 16:51
Yandex bot3407+62660.68 MB31 May 2011 - 15:59
Feedfetcher-Google343824.13 MB31 May 2011 - 23:49
MSNBot-media1729+988201.08 MB31 May 2011 - 21:41
Unknown robot (identified by 'spider')2105+72154.37 MB31 May 2011 - 08:00
Sogou Spider1836+15708.05 MB31 May 2011 - 05:35
BaiDuSpider1290+1521.60 GB31 May 2011 - 23:23
DoCoMo1341+1918.38 MB29 May 2011 - 05:04
Unknown robot (identified by empty user agent string)1209+87700.86 MB31 May 2011 - 23:27
Unknown robot (identified by 'robot')1113+3214.23 MB31 May 2011 - 22:42
Exabot945+7415.37 MB31 May 2011 - 13:30
Nutch559+265320.96 MB31 May 2011 - 12:20
bender focused_crawler608+912.45 GB31 May 2011 - 23:57
Unknown robot (identified by hit on 'robots.txt')0+63718.89 KB31 May 2011 - 23:50
Alexa (IA Archiver)515+10426.49 MB31 May 2011 - 06:05
MSNBot399+524.45 MB31 May 2011 - 03:25
Unknown robot (identified by '*bot')174+2173.79 MB31 May 2011 - 22:38
ichiro327+263.48 MB31 May 2011 - 13:14
WGet tools277991.70 MB31 May 2011 - 19:12
MJ12bot140+985.18 MB31 May 2011 - 05:21
Java (Often spam bot)205+1161.86 MB31 May 2011 - 14:12
WordPress15497.93 MB31 May 2011 - 04:38
yacy83+961.23 MB29 May 2011 - 19:12
Speedy Spider36+3926.60 MB31 May 2011 - 07:23
Findlinks23+48276.70 KB31 May 2011 - 10:00
Ask41+152.90 MB31 May 2011 - 16:27
FaceBook bot501.06 MB31 May 2011 - 19:39
CFNetwork49520.09 MB29 May 2011 - 07:57
Perl tool426.27 MB28 May 2011 - 14:57
Jakarta commons-httpclient3719.94 MB28 May 2011 - 06:47
BSpider0+31941 Bytes31 May 2011 - 17:21
Motor3066.99 MB24 May 2011 - 16:23
EasyDL23506.01 KB31 May 2011 - 21:38
Harvest222.77 MB27 May 2011 - 16:14
Mail.ru bot20+14.11 MB28 May 2011 - 02:14
Python-urllib1848.10 MB27 May 2011 - 16:39
GigaBot2+1240.26 KB17 May 2011 - 13:23
Custo6+66.86 MB28 May 2011 - 18:57
VORTEX12501.09 KB09 May 2011 - 00:49
NG 1.x (Exalead)1116.59 MB17 May 2011 - 22:12
UCSD Crawl11351.82 KB05 May 2011 - 13:55
The web archive (IA Archiver)0+9279 Bytes17 May 2011 - 08:24
Netcraft856.56 KB28 May 2011 - 14:20
HTMLParser7192.76 KB04 May 2011 - 07:55
legs3+470.98 KB31 May 2011 - 14:09
Checkbot5026 May 2011 - 03:52
WebCollage4113.82 KB24 May 2011 - 01:53
HTTrack off-line browser2+223.65 KB30 May 2011 - 02:47
W3C Link Checker2+262 Bytes18 May 2011 - 18:22
BBot213.31 MB21 May 2011 - 23:49
Fish search246.81 KB26 May 2011 - 10:17
Sven21.33 MB28 May 2011 - 10:49
archive.org bot0+258 Bytes27 May 2011 - 08:20
larbin1+123.96 KB10 May 2011 - 00:17
SuperBot124.17 KB23 May 2011 - 14:30
Feedburner1006 May 2011 - 07:35
Unknown robot (identified by 'checker')17.07 KB05 May 2011 - 02:56
LinkChecker0+131 Bytes03 May 2011 - 07:29
Y!J Yahoo Japan120.29 KB10 May 2011 - 01:03
Voyager15.07 MB24 May 2011 - 06:55
lwp-trivial17.07 KB14 May 2011 - 13:28
MSIECrawler0+131 Bytes22 May 2011 - 09:36
* Robots shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts. Numbers after + are successful hits on "robots.txt" files.



Advanced Web Statistics 6.95 (build 1.943) - Created by awstats (plugins: geoip)