Statistics for: thesis.library.caltech.eduAwstats Web Site
Last Update: 15 Jan 2010 - 11:06
Reported period:Month May 2008
Close window
 
Robots/Spiders visitors  
76 different robotsHitsBandwidthLast visit
Yahoo Slurp81880+950114.41 GB31 May 2008 - 23:58
MSNBot51178+12787.70 GB31 May 2008 - 23:51
Googlebot45346+9026.33 GB31 May 2008 - 23:59
Unknown robot (identified by 'crawl')41847+113912.24 GB31 May 2008 - 23:55
Ask8317+99124.93 MB31 May 2008 - 23:31
BaiDuSpider6999+47739.62 MB31 May 2008 - 23:56
Unknown robot (identified by 'discovery')6521+269.49 MB28 May 2008 - 13:06
Nutch6184+756.65 GB31 May 2008 - 22:22
Ocelli4853+32.52 GB15 May 2008 - 03:08
Unknown robot (identified by empty user agent string)4291+332436.11 MB31 May 2008 - 20:39
GigaBot1998+2451.70 GB31 May 2008 - 23:53
MSNBot-media1171+81318.94 MB31 May 2008 - 21:33
NimbleCrawler1164+312.21 MB21 May 2008 - 18:18
Unknown robot (identified by 'bot*')858+6460.49 MB31 May 2008 - 23:42
Harvest771274.74 MB31 May 2008 - 08:01
Voila337+350206.69 MB31 May 2008 - 23:02
Unknown robot (identified by hit on 'robots.txt')0+66080.34 KB31 May 2008 - 20:13
Speedy Spider451+711.86 GB31 May 2008 - 17:27
OutfoxBot/YodaoBot337+11634.85 MB29 May 2008 - 12:24
Java (Often spam bot)338+8102.44 MB31 May 2008 - 10:28
Exabot297+457.22 MB31 May 2008 - 23:34
Unknown robot (identified by 'robot')267+698.77 MB31 May 2008 - 21:16
Sogou Spider304+113.08 MB31 May 2008 - 11:33
Alexa (IA Archiver)225+28208.09 MB31 May 2008 - 21:38
Turn It In229+28.35 MB05 May 2008 - 17:24
twiceler132+3613.92 MB31 May 2008 - 18:02
WGet tools145+354.72 MB30 May 2008 - 19:00
Python-urllib129+15282.78 MB30 May 2008 - 12:07
Jakarta commons-httpclient101+3120.30 MB30 May 2008 - 04:57
Grub.org101+1531.98 MB18 May 2008 - 14:44
Perl tool10711.33 MB30 May 2008 - 18:56
Heritrix82+17.30 MB14 May 2008 - 15:59
CFNetwork81737.00 MB30 May 2008 - 20:40
yacy6225.75 MB30 May 2008 - 04:57
The web archive (IA Archiver)0+425.37 KB28 May 2008 - 08:50
Unknown robot (identified by 'spider')34+639.63 MB30 May 2008 - 18:29
BecomeBot29+61.20 MB31 May 2008 - 00:26
EasyDL25478.73 KB28 May 2008 - 07:35
MJ12bot12+12114.30 KB31 May 2008 - 20:22
NG 2.x (Exalead)0+202.56 KB31 May 2008 - 11:15
Holmes5+1339.88 KB31 May 2008 - 03:52
boitho.com-dc13+41.27 MB29 May 2008 - 20:43
BBot1519.72 MB31 May 2008 - 10:28
BSpider11+42.00 KB30 May 2008 - 00:59
Yandex bot10+4265.30 KB24 May 2008 - 13:46
larbin6+6274.83 KB21 May 2008 - 14:11
psbot6+331.68 MB17 May 2008 - 15:51
MSIECrawler0+91.02 KB31 May 2008 - 15:41
HTTrack off-line browser7+110.82 MB19 May 2008 - 14:44
WordPress81.05 MB27 May 2008 - 10:13
UCSD Crawl4+4524 Bytes30 May 2008 - 03:16
Custo74.83 MB28 May 2008 - 04:22
Checkbot7030 May 2008 - 03:51
noxtrumbot4+2696.48 KB20 May 2008 - 14:43
HTMLParser634.54 KB29 May 2008 - 21:46
Gaisbot3+31.00 MB15 May 2008 - 03:57
QihooBot584.94 KB30 May 2008 - 15:33
WebMiner0+5655 Bytes23 May 2008 - 07:20
WebCollage42.33 MB27 May 2008 - 20:04
nicebot2+224.08 KB24 May 2008 - 23:09
The World Wide Web Worm4028 May 2008 - 15:34
archive.org bot2+22.73 MB29 May 2008 - 16:16
Ingrid3417 Bytes22 May 2008 - 07:53
Internet Shinchakubin324.91 KB01 May 2008 - 07:44
DoCoMo235.10 KB19 May 2008 - 01:20
Spiderman1+1270 Bytes12 May 2008 - 20:01
lwp-request2030 May 2008 - 06:58
Fish search21.17 MB19 May 2008 - 04:45
ichiro1+1270 Bytes20 May 2008 - 04:32
Powermarks2014 May 2008 - 01:50
Web Core / Roots111.58 KB03 May 2008 - 17:47
INFOMINE VLCrawler113.31 KB19 May 2008 - 10:52
Robozilla1139 Bytes13 May 2008 - 08:34
FavIconizer1139 Bytes09 May 2008 - 00:07
Unknown robot (identified by 'hunter')114.66 KB21 May 2008 - 21:35
Others00 
* Robots shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts. Numbers after + are successful hits on "robots.txt" files.



Advanced Web Statistics 6.95 (build 1.943) - Created by awstats