Statistics for: thesis.library.caltech.eduAwstats Web Site
Last Update: 15 Jan 2010 - 11:06
Reported period:Month Apr 2008
Close window
 
Robots/Spiders visitors  
73 different robotsHitsBandwidthLast visit
Yahoo Slurp83057+2424110.68 GB30 Apr 2008 - 23:56
Unknown robot (identified by 'crawl')40817+103923.36 GB30 Apr 2008 - 23:59
Googlebot33081+7826.60 GB30 Apr 2008 - 23:57
MSNBot30863+8343.55 GB30 Apr 2008 - 23:59
BaiDuSpider13559+46755.72 MB30 Apr 2008 - 23:56
MSNBot-media8042+98691.27 MB30 Apr 2008 - 22:23
Ocelli7429+73.80 GB30 Apr 2008 - 14:14
Ask5727+125121.72 MB30 Apr 2008 - 23:12
Nutch5572+9410.60 GB30 Apr 2008 - 22:35
Unknown robot (identified by hit on 'robots.txt')0+3332417.95 KB30 Apr 2008 - 22:43
Unknown robot (identified by 'bot*')2719+105404.12 MB30 Apr 2008 - 21:56
GigaBot1499+146837.26 MB30 Apr 2008 - 23:56
twiceler1005+10016.48 MB30 Apr 2008 - 15:05
Unknown robot (identified by empty user agent string)454+265176.45 MB30 Apr 2008 - 22:24
WGet tools699+21.31 GB30 Apr 2008 - 19:01
Harvest639226.08 MB27 Apr 2008 - 12:59
Voila302+324175.40 MB30 Apr 2008 - 19:26
Java (Often spam bot)486+750.59 MB30 Apr 2008 - 21:53
MJ12bot417+224.02 MB30 Apr 2008 - 09:38
Exabot344+3512.47 MB30 Apr 2008 - 22:09
Unknown robot (identified by 'spider')32+29527.15 MB29 Apr 2008 - 07:39
Unknown robot (identified by 'discovery')291+104.07 MB30 Apr 2008 - 20:22
Unknown robot (identified by 'robot')225+486.92 MB30 Apr 2008 - 23:37
OutfoxBot/YodaoBot195+7328.89 MB30 Apr 2008 - 18:23
Turn It In264+219.12 MB26 Apr 2008 - 16:00
Alexa (IA Archiver)242+2069.49 MB30 Apr 2008 - 23:28
Perl tool220+177.44 MB30 Apr 2008 - 19:03
Mail.ru bot210+14.65 MB02 Apr 2008 - 21:35
Jakarta commons-httpclient144+221.80 MB30 Apr 2008 - 16:26
BecomeBot147+191.63 MB17 Apr 2008 - 17:03
CFNetwork1391.39 GB30 Apr 2008 - 10:40
noxtrumbot133+454.79 MB22 Apr 2008 - 20:31
Python-urllib81+2191.07 MB30 Apr 2008 - 15:31
Sogou Spider68+730.53 MB30 Apr 2008 - 23:37
yacy57+1415.29 MB29 Apr 2008 - 02:01
Speedy Spider33+954.57 MB30 Apr 2008 - 04:22
WordPress40126.60 KB18 Apr 2008 - 22:07
FaceBook bot3255.07 MB22 Apr 2008 - 18:23
NG 2.x (Exalead)0+273.45 KB30 Apr 2008 - 22:03
The web archive (IA Archiver)0+243.07 KB29 Apr 2008 - 09:27
Web Core / Roots154.80 MB29 Apr 2008 - 13:37
BBot1522.98 MB30 Apr 2008 - 16:58
UCSD Crawl9+628.02 KB27 Apr 2008 - 02:25
Grub.org7+7370.74 KB19 Apr 2008 - 20:32
Holmes1+1110.71 KB28 Apr 2008 - 18:36
Heritrix6+615.96 MB28 Apr 2008 - 18:29
MSIECrawler4+8110.05 KB28 Apr 2008 - 22:43
Custo1147.29 MB30 Apr 2008 - 00:09
psbot8+374.77 KB17 Apr 2008 - 16:11
archive.org bot5+511.54 MB18 Apr 2008 - 17:24
larbin6+345.07 KB29 Apr 2008 - 03:35
QihooBot82.99 MB11 Apr 2008 - 08:45
Gaisbot4+43.02 MB18 Apr 2008 - 10:44
Yandex bot5+1270 Bytes30 Apr 2008 - 16:16
EasyDL665.52 KB20 Apr 2008 - 05:11
boitho.com-dc4+215.82 KB30 Apr 2008 - 13:43
Unknown robot (identified by 'hunter')51.75 MB16 Apr 2008 - 21:21
BSpider0+5655 Bytes22 Apr 2008 - 22:27
IRLbot2+245.48 KB20 Apr 2008 - 01:57
The World Wide Web Worm415.77 KB22 Apr 2008 - 23:47
DoCoMo339.31 KB29 Apr 2008 - 13:58
Internet Shinchakubin327.67 KB21 Apr 2008 - 08:44
Checkbot3024 Apr 2008 - 03:26
Scooter328.94 KB30 Apr 2008 - 22:34
Unknown robot (identified by 'checker')2027 Apr 2008 - 12:50
Fish search222.93 KB25 Apr 2008 - 09:19
lwp-trivial2278 Bytes08 Apr 2008 - 12:34
SuperBot1139 Bytes03 Apr 2008 - 21:56
WebCollage115.77 KB27 Apr 2008 - 12:21
lwp-request1009 Apr 2008 - 17:12
Powermarks1021 Apr 2008 - 00:53
HTMLParser117.84 KB09 Apr 2008 - 12:24
WebMiner0+1131 Bytes07 Apr 2008 - 04:57
Others00 
* Robots shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts. Numbers after + are successful hits on "robots.txt" files.



Advanced Web Statistics 6.95 (build 1.943) - Created by awstats