Statistics for: thesis.library.caltech.eduAwstats Web Site
Last Update: 15 Jan 2010 - 11:06
Reported period:Month Feb 2009
Close window
 
Robots/Spiders visitors  
70 different robotsHitsBandwidthLast visit
Unknown robot (identified by 'crawl')447954+123665.45 GB28 Feb 2009 - 23:59
Googlebot36144+8473.90 GB28 Feb 2009 - 23:53
Yahoo Slurp34666+49747.78 GB28 Feb 2009 - 23:59
MSNBot15517+83129.93 GB28 Feb 2009 - 23:50
WGet tools10417+5159.88 MB28 Feb 2009 - 19:50
Nutch5578+79851.30 MB28 Feb 2009 - 20:07
Ask5352+1445.25 GB28 Feb 2009 - 23:53
HTTrack off-line browser405610.18 GB28 Feb 2009 - 16:32
BaiDuSpider2244+2193.74 MB28 Feb 2009 - 23:58
MSNBot-media2047+12844.41 MB28 Feb 2009 - 23:55
Unknown robot (identified by hit on 'robots.txt')0+1554198.80 KB28 Feb 2009 - 21:46
twiceler923+2722.02 MB28 Feb 2009 - 23:57
Unknown robot (identified by empty user agent string)624+309553.35 MB28 Feb 2009 - 23:07
Turn It In772+9753.94 MB28 Feb 2009 - 02:24
Voyager664+107.36 MB26 Feb 2009 - 09:27
Harvest633224.79 MB28 Feb 2009 - 11:13
Sogou Spider60640.71 MB28 Feb 2009 - 23:47
Voila562+30229.77 MB28 Feb 2009 - 23:40
Exabot395+3188.33 MB28 Feb 2009 - 04:50
Alexa (IA Archiver)259+5090.43 MB28 Feb 2009 - 17:35
Unknown robot (identified by 'robot')247+47238.67 MB28 Feb 2009 - 14:20
GigaBot193+29871.93 MB21 Feb 2009 - 11:45
Custo160+5681.21 MB28 Feb 2009 - 09:31
CFNetwork2092.09 GB28 Feb 2009 - 08:21
Java (Often spam bot)181+1357.21 MB28 Feb 2009 - 20:33
Unknown robot (identified by 'bot*')165+2360.14 MB27 Feb 2009 - 09:01
Perl tool152+1305.08 MB26 Feb 2009 - 12:35
Unknown robot (identified by 'spider')102+475.62 MB28 Feb 2009 - 20:27
Ocelli130+413.11 MB28 Feb 2009 - 23:33
Unknown robot (identified by 'discovery')127027 Feb 2009 - 02:58
Jakarta commons-httpclient54+1030.39 MB26 Feb 2009 - 23:54
Speedy Spider33+3115.40 MB25 Feb 2009 - 20:20
yacy56+71.52 MB28 Feb 2009 - 19:20
Geniebot28+28600.35 KB21 Feb 2009 - 15:03
Yanga WorldSearch Bot27+53.09 MB24 Feb 2009 - 07:24
BBot27+249.91 MB27 Feb 2009 - 15:09
The web archive (IA Archiver)0+263.33 KB26 Feb 2009 - 12:55
BSpider1+255.56 MB28 Feb 2009 - 21:16
psbot15+8117.65 MB27 Feb 2009 - 12:56
NG 2.x (Exalead)0+212.69 KB28 Feb 2009 - 12:30
Gaisbot15+51.10 MB25 Feb 2009 - 01:24
Heritrix9+4384.96 KB27 Feb 2009 - 13:38
Python-urllib8+320.90 KB24 Feb 2009 - 11:13
WordPress10176.73 KB27 Feb 2009 - 12:03
Yandex bot8+2743.49 KB19 Feb 2009 - 20:47
larbin4+617.40 KB28 Feb 2009 - 02:21
Checkbot9027 Feb 2009 - 08:17
UCSD Crawl5+45.04 MB20 Feb 2009 - 01:11
MSIECrawler8+11.09 MB27 Feb 2009 - 19:43
Grub.org4+338.37 KB28 Feb 2009 - 18:43
Walhello appie3+3810 Bytes28 Feb 2009 - 02:36
lwp-trivial618.20 MB24 Feb 2009 - 13:26
Powermarks5595.71 KB24 Feb 2009 - 15:38
Feedfetcher-Google48.94 MB28 Feb 2009 - 18:00
Netcraft4816.22 KB13 Feb 2009 - 17:29
T-H-U-N-D-E-R-S-T-O-N-E429.83 KB28 Feb 2009 - 18:52
FaceBook bot336.17 KB28 Feb 2009 - 15:59
Web Core / Roots325.38 KB26 Feb 2009 - 11:02
EasyDL326.54 KB04 Feb 2009 - 18:20
Snappy218.22 KB20 Feb 2009 - 01:05
Mail.ru bot1+1270 Bytes26 Feb 2009 - 23:08
OutfoxBot/YodaoBot0+2262 Bytes06 Feb 2009 - 20:23
DoCoMo222.72 KB12 Feb 2009 - 11:18
Y!J Yahoo Japan225.81 KB09 Feb 2009 - 03:12
archive.org bot1+1705.44 KB25 Feb 2009 - 01:57
RoadHouse Crawling System19.89 KB07 Feb 2009 - 04:44
Susie14.24 KB12 Feb 2009 - 16:25
WebCollage115.98 KB06 Feb 2009 - 16:53
Robozilla1139 Bytes13 Feb 2009 - 08:00
YahooSeeker Yahoo! Blog crawler0+1131 Bytes17 Feb 2009 - 05:19
Others00 
* Robots shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts. Numbers after + are successful hits on "robots.txt" files.



Advanced Web Statistics 6.95 (build 1.943) - Created by awstats