Statistics for: thesis.library.caltech.eduAwstats Web Site
Last Update: 15 Jan 2010 - 11:06
Reported period:Month Nov 2005
Close window
 
Robots/Spiders visitors  
92 different robotsHitsBandwidthLast visit
Googlebot97811+28355.53 GB30 Nov 2005 - 23:59
Unknown robot (identified by 'crawl')18073+59712.42 GB30 Nov 2005 - 23:44
Yahoo Slurp10555+12815.85 GB30 Nov 2005 - 23:50
MSNBot6087+3079.55 GB30 Nov 2005 - 23:59
Ask4185+12494.44 MB30 Nov 2005 - 22:35
Nutch3264+1128.11 MB28 Nov 2005 - 23:05
Ocelli2528+21.63 GB19 Nov 2005 - 19:10
RufusBot Rufus Web Miner2275+70205.77 MB27 Nov 2005 - 20:04
Harvest234031.47 MB29 Nov 2005 - 00:03
BecomeBot2251+5922.34 MB30 Nov 2005 - 23:22
ZyBorg1690+715.53 MB30 Nov 2005 - 23:53
Voyager1077+1210.36 MB30 Nov 2005 - 09:31
sohu agent87513.71 MB28 Nov 2005 - 13:32
Cfetch691+115.97 MB20 Nov 2005 - 02:06
psbot634+583.71 MB29 Nov 2005 - 19:07
Unknown robot (identified by empty user agent string)650+31971.84 MB30 Nov 2005 - 20:11
ConveraCrawler261+2919.05 MB30 Nov 2005 - 19:57
Turn It In201+228.85 MB20 Nov 2005 - 21:57
Unknown robot (identified by 'bot*')165+3826.32 MB28 Nov 2005 - 02:19
nicebot1853.42 MB30 Nov 2005 - 19:48
GigaBot97+8710.78 MB27 Nov 2005 - 05:24
Perl tool16019.20 MB30 Nov 2005 - 18:40
NG 2.x (Exalead)118+41.33 MB30 Nov 2005 - 01:51
ichiro107+111.38 MB30 Nov 2005 - 09:01
Jakarta commons-httpclient67+217.61 MB23 Nov 2005 - 16:55
DoCoMo77613.76 KB14 Nov 2005 - 23:44
Combine System27+24199.29 KB30 Nov 2005 - 21:06
Custo4931.01 MB30 Nov 2005 - 07:30
WGet tools48+1178.69 MB30 Nov 2005 - 19:55
Java (Often spam bot)43+39.37 MB30 Nov 2005 - 10:51
BaiDuSpider39+59.85 MB29 Nov 2005 - 19:30
SBIder22+22149.60 KB28 Nov 2005 - 15:53
IBM Almaden Research Center WebFountain™27+173.66 MB30 Nov 2005 - 13:15
Findlinks26+6270.64 KB28 Nov 2005 - 04:13
sohu-search20+101.69 MB28 Nov 2005 - 13:11
Argus20+101.46 MB27 Nov 2005 - 01:00
NutchCVS17+1256.84 KB30 Nov 2005 - 22:59
Alexa (IA Archiver)19+947.17 MB30 Nov 2005 - 18:27
Walhello appie13+14103.92 KB30 Nov 2005 - 18:32
Unknown robot (identified by 'robot')24+369.50 KB29 Nov 2005 - 19:58
Unknown robot (identified by 'spider')13+132.77 MB30 Nov 2005 - 02:17
CFNetwork26206.32 MB23 Nov 2005 - 08:50
Google AdSense20+31015.00 KB21 Nov 2005 - 12:47
Unknown robot (identified by hit on 'robots.txt')0+231.27 KB30 Nov 2005 - 01:07
Girafabot16+62.36 MB30 Nov 2005 - 21:05
lwp-trivial18154.99 KB30 Nov 2005 - 07:45
Voila8+935.59 KB29 Nov 2005 - 00:14
Yahoo-MMCrawler6+971.85 KB30 Nov 2005 - 21:46
IlTrovatore-Setaccio7+71.44 KB23 Nov 2005 - 11:50
Vagabondo7+7933.12 KB29 Nov 2005 - 22:51
Shim-Crawler5+510.85 KB13 Nov 2005 - 06:35
MJ12bot9+141.70 KB29 Nov 2005 - 00:04
Unknown robot (identified by 'discovery')8030 Nov 2005 - 19:58
Openfind data gatherer6+240.29 KB21 Nov 2005 - 06:42
Spiderman71.71 MB22 Nov 2005 - 07:20
UCSD Crawl72.03 MB08 Nov 2005 - 15:37
Kevin658.85 KB17 Nov 2005 - 11:10
Geniebot3+315.77 KB30 Nov 2005 - 14:52
aipbot3+342.83 KB30 Nov 2005 - 11:18
archive.org bot3+33.56 MB30 Nov 2005 - 22:30
IRLbot5695 Bytes17 Nov 2005 - 00:29
Powermarks5395.95 KB25 Nov 2005 - 04:05
MSIECrawler3+2144 Bytes30 Nov 2005 - 08:17
Ingrid2+231.44 KB17 Nov 2005 - 06:33
VSE2+2422 Bytes12 Nov 2005 - 22:46
INFOMINE VLCrawler2+2422 Bytes23 Nov 2005 - 16:28
Unknown robot (identified by 'checker')4390.35 KB26 Nov 2005 - 11:24
larbin1+2283 Bytes15 Nov 2005 - 00:12
UdmSearch1+1026 Nov 2005 - 17:46
DNSGroup1+1211 Bytes01 Nov 2005 - 23:01
WebCollage2600.66 KB30 Nov 2005 - 06:32
InfoSeek Robot 1.01+19.64 KB18 Nov 2005 - 09:51
Heritrix1+124.53 KB14 Nov 2005 - 11:48
Fish search2278 Bytes13 Nov 2005 - 04:16
The web archive (IA Archiver)0+2144 Bytes29 Nov 2005 - 18:09
Gaisbot1+1211 Bytes19 Nov 2005 - 07:46
W3C Link Checker1+172 Bytes10 Nov 2005 - 17:31
KnowItAll1+15.02 KB14 Nov 2005 - 21:38
MSRBOT1+18.70 KB13 Nov 2005 - 07:10
W3C Validator112.05 KB21 Nov 2005 - 19:19
Asterias0+172 Bytes13 Nov 2005 - 04:15
Robozilla1139 Bytes24 Nov 2005 - 18:42
HTTrack off-line browser171.85 KB16 Nov 2005 - 19:39
Python-urllib14.98 MB01 Nov 2005 - 20:54
Fooky.com/ScorpionBot/ScoutOut1139 Bytes07 Nov 2005 - 09:53
Accoona-AI-Agent0+172 Bytes01 Nov 2005 - 01:49
Pompos0+172 Bytes25 Nov 2005 - 02:51
Scooter0+172 Bytes01 Nov 2005 - 13:21
Exabot1028 Nov 2005 - 22:21
Others03.23 KB 
* Robots shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts. Numbers after + are successful hits on "robots.txt" files.



Advanced Web Statistics 6.95 (build 1.943) - Created by awstats