Statistics for: thesis.library.caltech.eduAwstats Web Site
Last Update: 15 Jan 2010 - 11:06
Reported period:Month May 2006
Close window
 
Robots/Spiders visitors  
91 different robotsHitsBandwidthLast visit
Googlebot251080+7774.63 GB31 May 2006 - 23:59
Yahoo Slurp33036+511526.67 GB31 May 2006 - 23:58
Unknown robot (identified by 'crawl')22062+65415.11 GB31 May 2006 - 23:52
MSNBot10890+61318.20 GB31 May 2006 - 23:44
Ask10802+99157.07 MB31 May 2006 - 23:45
noxtrumbot3083+113.01 GB31 May 2006 - 10:11
Ocelli2511+21.32 GB27 May 2006 - 01:05
Nutch1846+3517.76 MB31 May 2006 - 07:19
Heritrix1398+46.95 GB31 May 2006 - 10:34
GigaBot723+352109.25 MB31 May 2006 - 20:15
BecomeBot871+1288.59 MB24 May 2006 - 21:16
ConveraCrawler980+82.96 GB29 May 2006 - 12:34
Unknown robot (identified by empty user agent string)910+78536.49 MB31 May 2006 - 20:28
Voyager904+2210.78 MB31 May 2006 - 23:59
ksibot853+3850.81 MB26 May 2006 - 08:27
MSIECrawler617+5468.57 MB31 May 2006 - 18:21
Unknown robot (identified by 'robot')524+64.41 MB31 May 2006 - 19:18
Unknown robot (identified by 'bot*')428+56118.84 MB31 May 2006 - 05:27
UdmSearch4143.70 MB07 May 2006 - 19:45
Turn It In397+3960.63 MB18 May 2006 - 14:17
Unknown robot (identified by 'spider')252+6859.64 MB23 May 2006 - 07:39
Unknown robot (identified by hit on 'robots.txt')0+24116.80 KB31 May 2006 - 14:25
Alexa (IA Archiver)210+22114.40 MB30 May 2006 - 19:54
NutchCVS133+227.16 MB30 May 2006 - 02:27
HTTrack off-line browser132+34.90 MB31 May 2006 - 07:22
bender focused_crawler1061.06 MB10 May 2006 - 15:15
Java (Often spam bot)60+4518.09 MB31 May 2006 - 17:43
Perl tool94+15.07 MB31 May 2006 - 18:21
Combine System46+461.75 MB31 May 2006 - 15:44
BBot79237.45 MB27 May 2006 - 20:41
MSNBot-media57+218.47 MB31 May 2006 - 17:18
WGet tools68+916.55 MB28 May 2006 - 17:34
ichiro46+29379.44 KB31 May 2006 - 14:03
BaiDuSpider59+918.53 MB29 May 2006 - 20:40
lanshanbot41+2610.05 MB23 May 2006 - 15:30
SBIder28+27219.78 KB23 May 2006 - 02:57
Harvest532.09 MB28 May 2006 - 12:02
Sogou Spider426.98 MB31 May 2006 - 14:09
CFNetwork37280.63 MB31 May 2006 - 00:53
aipbot18+18728.72 KB31 May 2006 - 15:51
Unknown robot (identified by 'discovery')32028 May 2006 - 17:14
Girafabot20+123.46 MB26 May 2006 - 08:01
psbot16+15141.75 KB31 May 2006 - 14:14
Findlinks21+776.97 KB29 May 2006 - 20:27
nicebot28267.57 KB31 May 2006 - 04:56
Spiderman28236.21 KB15 May 2006 - 03:32
Voila11+144.76 MB22 May 2006 - 22:57
Yahoo-MMCrawler14+10720 Bytes31 May 2006 - 22:30
Custo1915.78 MB31 May 2006 - 07:21
Web Core / Roots17+1113.75 KB28 May 2006 - 18:37
ZyBorg9+7592.66 KB29 May 2006 - 05:42
Sina Iask Spider151.49 MB28 May 2006 - 23:15
Walhello appie8+763.28 KB28 May 2006 - 19:01
Exabot11+3311.58 KB31 May 2006 - 23:57
Scooter0+12864 Bytes28 May 2006 - 03:57
IBM Almaden Research Center WebFountain™4+89.62 KB18 May 2006 - 10:09
larbin9+375.73 KB26 May 2006 - 20:04
WebCollage93.56 MB25 May 2006 - 21:35
Jakarta commons-httpclient910.34 MB29 May 2006 - 16:04
Shim-Crawler4+4844 Bytes12 May 2006 - 07:33
BSpider0+8576 Bytes18 May 2006 - 06:15
Gaisbot4+36.04 KB19 May 2006 - 21:34
ASpider (Associative Spider)3+3633 Bytes24 May 2006 - 17:53
IRLbot3+346.75 KB31 May 2006 - 23:31
Unknown robot (identified by 'checker')6314.00 KB26 May 2006 - 11:30
W3C Link Checker3+3216 Bytes27 May 2006 - 19:31
Unknown robot (identified by 'hunter')5236.61 KB16 May 2006 - 22:00
Google AdSense558.33 KB21 May 2006 - 13:37
Krugle2+219.28 KB02 May 2006 - 18:29
Geniebot2+27.86 KB20 May 2006 - 02:50
wume crawler3+1709.83 KB30 May 2006 - 13:19
FavOrg316.26 KB05 May 2006 - 18:45
MJ12bot1+21.92 KB05 May 2006 - 04:27
LinkChecker316.11 KB23 May 2006 - 02:35
KnowItAll0+3216 Bytes31 May 2006 - 14:17
Ingrid1+115.72 KB19 May 2006 - 00:56
DoCoMo213.54 KB13 May 2006 - 07:53
twiceler1+1211 Bytes20 May 2006 - 21:53
InfoSeek Robot 1.01+19.64 KB28 May 2006 - 13:18
Powermarks2029 May 2006 - 04:20
The web archive (IA Archiver)0+2144 Bytes24 May 2006 - 03:35
UCSD Crawl29.32 KB22 May 2006 - 11:27
Speedy Spider1+1211 Bytes05 May 2006 - 20:04
SuperBot1139 Bytes07 May 2006 - 11:20
Kevin1476.23 KB16 May 2006 - 06:02
RoboCrawl Spider0+172 Bytes30 May 2006 - 18:35
INFOMINE VLCrawler113.00 KB03 May 2006 - 10:39
StackRambler0+172 Bytes13 May 2006 - 15:56
Netcraft1008 May 2006 - 04:34
PyQuery17.67 KB18 May 2006 - 12:44
Boris13.70 MB17 May 2006 - 07:39
Others04 Bytes 
* Robots shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts. Numbers after + are successful hits on "robots.txt" files.



Advanced Web Statistics 6.95 (build 1.943) - Created by awstats