Statistics for: thesis.library.caltech.eduAwstats Web Site
Last Update: 15 Jan 2010 - 11:06
Reported period:Month Sep 2007
Close window
 
Robots/Spiders visitors  
73 different robotsHitsBandwidthLast visit
Yahoo Slurp34526+23428.96 GB30 Sep 2007 - 23:59
MSNBot30747+237843.65 GB30 Sep 2007 - 23:55
Unknown robot (identified by 'crawl')31508+83615.34 GB30 Sep 2007 - 23:55
Googlebot27061+913.21 GB30 Sep 2007 - 23:59
Nutch17366+76365.50 MB30 Sep 2007 - 11:06
MSNBot-media6032+109720.16 MB30 Sep 2007 - 21:41
Ask6006+10498.72 MB30 Sep 2007 - 23:42
Heritrix5184+918.72 GB24 Sep 2007 - 04:44
ConveraCrawler1775+74.76 GB25 Sep 2007 - 08:42
MJ12bot1747+311.19 GB30 Sep 2007 - 23:17
BecomeBot907+33614.35 MB30 Sep 2007 - 23:13
Unknown robot (identified by empty user agent string)854+335214.13 MB30 Sep 2007 - 21:32
Speedy Spider722+783.23 GB30 Sep 2007 - 23:56
BaiDuSpider759+831.78 MB30 Sep 2007 - 23:04
Unknown robot (identified by 'bot*')626+7513.21 MB30 Sep 2007 - 22:39
Harvest502174.90 MB30 Sep 2007 - 11:47
Python-urllib430+35843.12 MB30 Sep 2007 - 13:04
Unknown robot (identified by 'robot')237+22011.10 MB29 Sep 2007 - 03:07
Perl tool346+159.92 MB24 Sep 2007 - 23:47
Java (Often spam bot)33423.04 MB29 Sep 2007 - 01:19
Unknown robot (identified by hit on 'robots.txt')0+28519.90 KB30 Sep 2007 - 15:51
Voila121+1277.49 MB30 Sep 2007 - 19:26
Gaisbot179+104.64 MB29 Sep 2007 - 17:55
Jakarta commons-httpclient1879.56 MB30 Sep 2007 - 14:49
Voyager163+144.56 MB30 Sep 2007 - 22:38
Alexa (IA Archiver)125+2459.08 MB30 Sep 2007 - 15:32
MSIECrawler129+191.30 MB30 Sep 2007 - 11:49
GigaBot39+8361.15 MB27 Sep 2007 - 21:06
OutfoxBot/YodaoBot91+214.61 MB30 Sep 2007 - 18:51
twiceler45+61393.53 KB29 Sep 2007 - 17:16
SynooBot97+66.49 MB28 Sep 2007 - 19:59
WGet tools70+3196.73 MB27 Sep 2007 - 23:44
CFNetwork70408.05 MB30 Sep 2007 - 23:17
Ocelli65+58.01 MB29 Sep 2007 - 19:08
Exabot37+7725.64 KB30 Sep 2007 - 08:00
Sogou Spider27+1214.73 MB28 Sep 2007 - 23:05
Unknown robot (identified by 'discovery')37030 Sep 2007 - 13:52
psbot17+1441.71 KB25 Sep 2007 - 16:26
UdmSearch26+2243.47 KB13 Sep 2007 - 11:18
MSRBOT18+69.12 MB30 Sep 2007 - 09:47
Custo2361.02 MB27 Sep 2007 - 05:01
Unknown robot (identified by 'spider')16+68.81 MB29 Sep 2007 - 14:44
Yahoo-MMCrawler12+927.73 KB28 Sep 2007 - 19:36
Holmes1+181.40 KB28 Sep 2007 - 07:26
DoCoMo11439.75 KB21 Sep 2007 - 17:07
The web archive (IA Archiver)0+11792 Bytes26 Sep 2007 - 09:08
Google AdSense9+110.21 MB23 Sep 2007 - 06:10
yacy5+4983 Bytes23 Sep 2007 - 12:55
Web Core / Roots6+15.85 MB22 Sep 2007 - 15:20
EasyDL7904.88 KB13 Sep 2007 - 21:27
Combine System3+456.78 KB26 Sep 2007 - 00:59
lwp-trivial74.47 MB27 Sep 2007 - 21:30
QihooBot61.27 MB29 Sep 2007 - 06:29
Girafabot0+5360 Bytes11 Sep 2007 - 10:20
nicebot3+128.19 KB27 Sep 2007 - 02:30
Powermarks4591.98 KB28 Sep 2007 - 10:54
Checkbot4027 Sep 2007 - 03:07
W3C Link Checker2+2144 Bytes14 Sep 2007 - 07:34
larbin2+211.99 KB30 Sep 2007 - 14:30
Cursor326.98 KB12 Sep 2007 - 16:14
Internet Shinchakubin326.31 KB24 Sep 2007 - 11:56
The World Wide Web Worm315.77 KB16 Sep 2007 - 22:39
Netcraft320.47 KB10 Sep 2007 - 12:51
INFOMINE VLCrawler1+1211 Bytes22 Sep 2007 - 23:34
WebReaper1+172 Bytes20 Sep 2007 - 05:53
HTTrack off-line browser2406.83 KB22 Sep 2007 - 18:28
Unknown robot (identified by '*bot')1+110.30 KB26 Sep 2007 - 12:47
boitho.com-dc1+110.34 KB30 Sep 2007 - 10:11
YahooSeeker Yahoo! Blog crawler1+1211 Bytes05 Sep 2007 - 12:35
NutchCVS1+1211 Bytes26 Sep 2007 - 01:16
archive.org bot1+12.04 MB26 Sep 2007 - 06:08
Kevin1111.33 KB20 Sep 2007 - 07:00
Yandex bot17.83 KB01 Sep 2007 - 16:07
Others03 Bytes 
* Robots shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts. Numbers after + are successful hits on "robots.txt" files.



Advanced Web Statistics 6.95 (build 1.943) - Created by awstats