Statistics for: thesis.library.caltech.eduAwstats Web Site
Last Update: 15 Jan 2010 - 11:06
Reported period:Month Sep 2006
Close window
 
Robots/Spiders visitors  
89 different robotsHitsBandwidthLast visit
Googlebot37420+8151.42 GB30 Sep 2006 - 23:54
Unknown robot (identified by 'crawl')35213+63465.01 GB30 Sep 2006 - 23:59
Yahoo Slurp28414+216123.53 GB30 Sep 2006 - 23:59
Ask30280+223370.80 MB30 Sep 2006 - 23:57
MSNBot14929+72718.95 GB30 Sep 2006 - 23:53
Heritrix7495+3010.20 GB30 Sep 2006 - 23:31
NutchCVS5004+13126.70 MB30 Sep 2006 - 19:23
HTTrack off-line browser3355+11.77 GB23 Sep 2006 - 00:49
Ocelli2522+21.31 GB25 Sep 2006 - 05:59
Alexa (IA Archiver)1740+191.33 GB27 Sep 2006 - 11:37
MSNBot-media1439+4153.55 MB30 Sep 2006 - 23:04
Voyager882+1212.60 MB25 Sep 2006 - 02:31
Unknown robot (identified by empty user agent string)754+54241.95 MB30 Sep 2006 - 11:48
Unknown robot (identified by 'bot*')388+14148.48 MB30 Sep 2006 - 22:59
Perl tool511+195.67 MB30 Sep 2006 - 23:44
BecomeBot351+693.45 MB30 Sep 2006 - 23:59
Java (Often spam bot)411+139.80 MB30 Sep 2006 - 11:50
ConveraCrawler385+11.10 GB09 Sep 2006 - 06:33
ZyBorg249+12.79 MB30 Sep 2006 - 23:29
MJ12bot143+723.31 MB20 Sep 2006 - 00:02
Sogou Spider142+642.89 MB30 Sep 2006 - 14:06
BaiDuSpider113+1751.64 MB30 Sep 2006 - 10:15
IBM Almaden Research Center WebFountain™15+10463.83 MB21 Sep 2006 - 14:25
Turn It In106+128.07 MB30 Sep 2006 - 23:59
Nutch67+38636.41 KB29 Sep 2006 - 14:51
Unknown robot (identified by hit on 'robots.txt')0+875.91 KB30 Sep 2006 - 23:58
Exabot66+18713.42 KB29 Sep 2006 - 22:25
RoboCrawl Spider81+13.96 MB07 Sep 2006 - 11:59
GigaBot42+3931.01 MB30 Sep 2006 - 15:26
SBIder32+391.35 MB30 Sep 2006 - 19:15
Jakarta commons-httpclient61113.29 MB28 Sep 2006 - 22:09
Python-urllib6022.71 MB29 Sep 2006 - 21:40
nicebot58+11.07 MB27 Sep 2006 - 15:39
ichiro29+22273.70 KB29 Sep 2006 - 22:14
Sina Iask Spider495.65 MB30 Sep 2006 - 11:03
Fluid Dynamics Search Engine robot25+249.05 MB29 Sep 2006 - 10:12
Harvest47973.54 KB30 Sep 2006 - 04:53
ASpider (Associative Spider)22+2219.25 KB29 Sep 2006 - 16:44
Voila18+24921.25 KB27 Sep 2006 - 14:29
WGet tools38+2127.45 MB29 Sep 2006 - 04:53
psbot22+156.93 MB26 Sep 2006 - 01:41
CFNetwork35235.04 MB28 Sep 2006 - 10:58
Findlinks15+2050.71 KB30 Sep 2006 - 18:14
lanshanbot16+1677.26 KB29 Sep 2006 - 20:55
Custo3130.57 MB29 Sep 2006 - 22:04
Unknown robot (identified by 'spider')20+77.23 MB28 Sep 2006 - 06:20
Shim-Crawler18+6699.77 KB29 Sep 2006 - 11:51
The web archive (IA Archiver)0+241.69 KB29 Sep 2006 - 09:08
Yahoo-MMCrawler12+10720 Bytes28 Sep 2006 - 23:15
larbin17+414.20 MB15 Sep 2006 - 04:25
WebCollage18182.86 KB23 Sep 2006 - 15:46
NG 1.x (Exalead)18186.35 KB11 Sep 2006 - 15:11
Speedy Spider7+91.58 KB28 Sep 2006 - 02:26
Girafabot8+51.54 MB29 Sep 2006 - 11:11
Unknown robot (identified by 'robot')10+247.50 KB27 Sep 2006 - 19:39
MSIECrawler8+43.79 MB25 Sep 2006 - 23:47
Walhello appie8+385.84 KB29 Sep 2006 - 18:09
NetSprint10226.83 KB30 Sep 2006 - 18:14
MSRBOT9+119.44 MB28 Sep 2006 - 02:25
BSpider8+118.83 MB07 Sep 2006 - 05:03
W3C Link Checker5+4288 Bytes23 Sep 2006 - 20:55
Gaisbot4+46.11 KB23 Sep 2006 - 18:26
Unknown robot (identified by 'discovery')7025 Sep 2006 - 09:26
Unknown robot (identified by 'checker')7259.09 KB27 Sep 2006 - 06:24
Combine System3+453.74 KB23 Sep 2006 - 09:56
Scooter0+7504 Bytes27 Sep 2006 - 02:55
InfoSeek Robot 1.03+314.16 KB10 Sep 2006 - 16:08
Kevin429.00 KB19 Sep 2006 - 08:21
Web Core / Roots2+1373.51 KB24 Sep 2006 - 15:50
Cursor329.28 KB16 Sep 2006 - 11:00
Powermarks3019 Sep 2006 - 01:19
Cfetch3014 Sep 2006 - 05:06
Ingrid1+115.72 KB25 Sep 2006 - 13:26
INFOMINE VLCrawler1+1211 Bytes24 Sep 2006 - 00:38
Openfind data gatherer231.54 KB29 Sep 2006 - 10:34
HooWWWer1+1211 Bytes26 Sep 2006 - 08:20
EasyDL2231.92 KB22 Sep 2006 - 13:58
Pompos1+1211 Bytes29 Sep 2006 - 17:43
LinkChecker1+117.09 KB09 Sep 2006 - 20:20
UCSD Crawl280.44 KB28 Sep 2006 - 18:16
Google AdSense219.93 KB20 Sep 2006 - 09:36
aipbot1+18.76 KB27 Sep 2006 - 09:30
lwp-trivial0+2144 Bytes19 Sep 2006 - 03:13
Holmes0+172 Bytes24 Sep 2006 - 22:15
yacy17.95 KB22 Sep 2006 - 03:14
Unknown robot (identified by '*bot')19.99 KB05 Sep 2006 - 12:42
PyQuery19.15 KB11 Sep 2006 - 16:40
boitho.com-dc0+172 Bytes12 Sep 2006 - 22:54
Others00 
* Robots shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts. Numbers after + are successful hits on "robots.txt" files.



Advanced Web Statistics 6.95 (build 1.943) - Created by awstats