Statistics for: thesis.library.caltech.eduAwstats Web Site
Last Update: 15 Jan 2010 - 11:06
Reported period:Month Dec 2007
Close window
 
Robots/Spiders visitors  
78 different robotsHitsBandwidthLast visit
Unknown robot (identified by 'crawl')34584+119516.07 GB31 Dec 2007 - 23:57
Yahoo Slurp33278+31724.92 GB31 Dec 2007 - 23:57
Googlebot31798+8124.00 GB31 Dec 2007 - 23:55
MSNBot21881+119340.06 GB31 Dec 2007 - 23:58
Heritrix7529+1218.18 GB12 Dec 2007 - 11:59
Ask5459+132120.97 MB31 Dec 2007 - 23:57
MSNBot-media4878+110635.75 MB31 Dec 2007 - 19:11
BaiDuSpider4410+49170.22 MB31 Dec 2007 - 22:55
twiceler2856+107229.65 MB29 Dec 2007 - 07:38
MSRBOT3723+462.54 MB08 Dec 2007 - 09:54
Unknown robot (identified by hit on 'robots.txt')0+3099396.33 KB31 Dec 2007 - 23:54
Ocelli2502+21.27 GB26 Dec 2007 - 20:12
Nutch2189+224396.83 MB31 Dec 2007 - 23:54
MJ12bot2258+5340.79 MB31 Dec 2007 - 07:59
Unknown robot (identified by empty user agent string)1147+337457.64 MB31 Dec 2007 - 22:45
Harvest784285.96 MB30 Dec 2007 - 11:33
BecomeBot495+2176.46 MB30 Dec 2007 - 15:14
Speedy Spider536+733.30 GB31 Dec 2007 - 21:12
Unknown robot (identified by 'bot*')468+1272.82 GB31 Dec 2007 - 23:34
Java (Often spam bot)511+132.62 MB31 Dec 2007 - 02:36
Voila219+24318.04 MB31 Dec 2007 - 20:30
Turn It In435+311.97 MB20 Dec 2007 - 15:19
psbot272+333.37 MB22 Dec 2007 - 06:24
Python-urllib224+46268.86 MB31 Dec 2007 - 23:41
BSpider2563.00 MB30 Dec 2007 - 11:11
Jakarta commons-httpclient2409.51 MB31 Dec 2007 - 18:00
Alexa (IA Archiver)173+30111.85 MB30 Dec 2007 - 10:52
Exabot144+273.07 MB31 Dec 2007 - 16:37
MSIECrawler91+1712.00 MB30 Dec 2007 - 23:33
Unknown robot (identified by 'spider')87+783.65 MB31 Dec 2007 - 23:41
OutfoxBot/YodaoBot71+184.60 MB29 Dec 2007 - 13:02
GigaBot45+4247.61 MB30 Dec 2007 - 06:43
QihooBot801.85 MB31 Dec 2007 - 23:44
Unknown robot (identified by 'robot')37+342.30 MB30 Dec 2007 - 07:30
CFNetwork64458.91 MB31 Dec 2007 - 01:58
Sogou Spider60+423.47 MB29 Dec 2007 - 21:03
WGet tools4765.18 MB31 Dec 2007 - 14:44
Perl tool472.06 MB28 Dec 2007 - 14:12
Grub.org20+201.09 MB31 Dec 2007 - 11:29
The web archive (IA Archiver)2+3887.56 KB29 Dec 2007 - 17:19
Voyager19+71.13 MB23 Dec 2007 - 15:18
larbin19+7148.49 KB29 Dec 2007 - 09:20
NG 2.x (Exalead)0+212.69 KB30 Dec 2007 - 13:14
Yahoo-MMCrawler11+81.02 KB27 Dec 2007 - 03:55
yacy10+6571.66 KB30 Dec 2007 - 19:24
boitho.com-dc11+475.94 KB31 Dec 2007 - 16:59
Holmes7+71.02 MB29 Dec 2007 - 01:10
DoCoMo142.19 MB20 Dec 2007 - 02:58
Yandex bot10+41.05 KB28 Dec 2007 - 19:33
UCSD Crawl7+724.13 MB28 Dec 2007 - 15:24
Custo133.14 MB19 Dec 2007 - 05:30
WebCollage116.31 MB20 Dec 2007 - 11:20
Unknown robot (identified by 'discovery')10020 Dec 2007 - 10:43
EasyDL10118.44 KB29 Dec 2007 - 03:15
nicebot5+453.58 KB27 Dec 2007 - 12:35
HTTrack off-line browser8+13.87 MB31 Dec 2007 - 01:54
INFOMINE VLCrawler3+11.05 MB27 Dec 2007 - 09:05
Fish search41.07 MB29 Dec 2007 - 19:17
The World Wide Web Worm415.77 KB29 Dec 2007 - 13:50
Powermarks4456.09 KB19 Dec 2007 - 00:25
Checkbot4027 Dec 2007 - 03:34
Web Core / Roots39.83 MB27 Dec 2007 - 10:58
Internet Shinchakubin330.00 KB19 Dec 2007 - 19:54
YahooSeeker Yahoo! Blog crawler2+117.14 KB14 Dec 2007 - 18:39
NutchCVS0+3393 Bytes27 Dec 2007 - 11:27
Google AdSense333.10 KB27 Dec 2007 - 12:56
Sina Iask Spider2396.11 KB06 Dec 2007 - 06:52
Seekbot1+16.65 KB08 Dec 2007 - 12:14
BBot26.68 MB20 Dec 2007 - 09:05
Unknown robot (identified by 'checker')21.05 MB28 Dec 2007 - 07:01
Cfetch2028 Dec 2007 - 10:00
noxtrumbot0+2262 Bytes19 Dec 2007 - 22:31
archive.org bot1+12.04 MB01 Dec 2007 - 18:58
FaceBook bot116.47 MB10 Dec 2007 - 11:21
Robozilla1139 Bytes09 Dec 2007 - 02:43
Unknown robot (identified by '*bot')18.36 KB05 Dec 2007 - 06:58
Pogodak.com0+1131 Bytes21 Dec 2007 - 13:09
lwp-trivial1139 Bytes15 Dec 2007 - 17:36
Others00 
* Robots shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts. Numbers after + are successful hits on "robots.txt" files.



Advanced Web Statistics 6.95 (build 1.943) - Created by awstats