Statistics for: thesis.library.caltech.eduAwstats Web Site
Last Update: 15 Jan 2010 - 11:06
Reported period:Month May 2009
Close window
 
Robots/Spiders visitors  
71 different robotsHitsBandwidthLast visit
Unknown robot (identified by 'crawl')2019710+156031.60 GB31 May 2009 - 21:09
MSNBot40061+199684.97 GB31 May 2009 - 23:59
Yahoo Slurp34418+33287.21 GB31 May 2009 - 23:57
Googlebot28744+10581.99 GB31 May 2009 - 23:55
Nutch8934+66215.29 MB31 May 2009 - 18:27
BaiDuSpider8696+44404.94 MB31 May 2009 - 23:50
Ask7166+1426.90 GB31 May 2009 - 23:52
WGet tools5724+1827.12 MB31 May 2009 - 22:17
twiceler3533+6053.31 MB31 May 2009 - 22:11
Sogou Spider3347+1153.27 MB31 May 2009 - 22:57
MSNBot-media2698+18674.24 MB31 May 2009 - 20:16
Unknown robot (identified by empty user agent string)1903+302396.00 MB31 May 2009 - 22:24
Unknown robot (identified by hit on 'robots.txt')0+1235157.99 KB31 May 2009 - 22:23
Harvest1031381.46 MB31 May 2009 - 17:21
Turn It In926+5123.21 MB19 May 2009 - 21:46
Exabot755+43103.01 MB31 May 2009 - 20:37
larbin525+1225.21 MB31 May 2009 - 21:05
Voila471+37198.63 MB31 May 2009 - 23:40
Unknown robot (identified by 'bot*')384+76116.49 MB31 May 2009 - 23:44
Alexa (IA Archiver)307+83131.82 MB31 May 2009 - 23:14
yacy305+2316.26 MB31 May 2009 - 09:04
Unknown robot (identified by 'robot')227+56182.97 MB31 May 2009 - 22:01
Unknown robot (identified by '*bot')10+2342.07 MB31 May 2009 - 23:57
Python-urllib171+59414.02 MB31 May 2009 - 17:50
Jakarta commons-httpclient188+101.07 GB30 May 2009 - 08:51
UCSD Crawl87+8748.28 MB31 May 2009 - 23:15
GigaBot97+769.20 MB30 May 2009 - 07:20
Custo101+4628.79 MB31 May 2009 - 12:58
Perl tool14020.79 MB31 May 2009 - 00:14
Ocelli127+414.31 MB28 May 2009 - 17:16
Unknown robot (identified by 'spider')86+2752.34 MB31 May 2009 - 19:21
Java (Often spam bot)70+35618.18 MB31 May 2009 - 22:43
Speedy Spider40+5120.47 MB31 May 2009 - 20:46
Unknown robot (identified by 'discovery')77030 May 2009 - 01:39
CFNetwork74581.72 MB31 May 2009 - 23:59
Gaisbot66+4705.20 KB31 May 2009 - 07:49
lwp-trivial5069.43 MB29 May 2009 - 05:51
Yanga WorldSearch Bot34+83.91 MB31 May 2009 - 20:40
BBot3487.71 MB30 May 2009 - 23:45
BSpider24+762.39 MB26 May 2009 - 14:25
NG 2.x (Exalead)1+243.35 MB30 May 2009 - 10:22
psbot13+119.32 KB18 May 2009 - 15:43
Yandex bot11+123.03 KB31 May 2009 - 06:22
FaceBook bot19289.48 KB21 May 2009 - 17:20
MJ12bot17+25.66 MB29 May 2009 - 14:58
MSIECrawler12+42.66 MB30 May 2009 - 12:10
The web archive (IA Archiver)0+151.92 KB30 May 2009 - 03:33
WordPress1215.10 KB29 May 2009 - 06:45
Checkbot11031 May 2009 - 23:08
Voyager4+61.07 MB19 May 2009 - 17:15
OutfoxBot/YodaoBot5+416.64 KB29 May 2009 - 01:23
WebCollage75.26 MB23 May 2009 - 02:53
Google AdSense75.65 MB31 May 2009 - 16:05
Fish search567.55 KB28 May 2009 - 23:43
Metaspinner2+2380.37 KB17 May 2009 - 13:20
Netcraft4812.22 KB04 May 2009 - 18:38
T-H-U-N-D-E-R-S-T-O-N-E434.49 KB20 May 2009 - 10:22
HTMLParser437.04 KB29 May 2009 - 18:05
NutchCVS2+2540 Bytes17 May 2009 - 12:38
Web Core / Roots2+12.83 MB17 May 2009 - 01:11
Powermarks31.07 MB25 May 2009 - 00:42
Sunrise330.40 KB17 May 2009 - 02:09
Unknown robot (identified by 'hunter')32.93 MB18 May 2009 - 03:25
DoCoMo1+16.74 KB23 May 2009 - 05:22
QihooBot2653.39 KB08 May 2009 - 03:22
Findlinks1139 Bytes13 May 2009 - 17:07
Feedfetcher-Google18.94 MB28 May 2009 - 02:46
HTTrack off-line browser1020 May 2009 - 01:09
Unknown robot (identified by 'checker')15.41 KB10 May 2009 - 23:31
Y!J Yahoo Japan111.53 KB10 May 2009 - 22:37
Emacs-w3 Search Engine11.83 MB11 May 2009 - 20:13
Others00 
* Robots shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts. Numbers after + are successful hits on "robots.txt" files.



Advanced Web Statistics 6.95 (build 1.943) - Created by awstats