Statistics for:  thesis.library.caltech.edu Last Update:  04 Oct 2011 - 14:52 Reported period: Month Sep 2011

Close window

 

Robots/Spiders visitors

68 different robots Hits Bandwidth Last visit Googlebot 86391+96 31.90 GB 30 Sep 2011 - 23:59 Yahoo Slurp 39183+216 8.38 GB 30 Sep 2011 - 23:57 Unknown robot (identified by 'bot*') 23729+822 11.53 GB 30 Sep 2011 - 23:58 Unknown robot (identified by 'crawl') 20658+823 28.52 GB 30 Sep 2011 - 23:57 Unknown robot (identified by 'robot') 10854+39 786.78 MB 30 Sep 2011 - 23:53 Yandex bot 7776+66 7.88 GB 30 Sep 2011 - 23:59 BaiDuSpider 5272+87 2.20 GB 30 Sep 2011 - 23:39 MSNBot-media 3758+1501 89.03 MB 30 Sep 2011 - 23:36 Sogou Spider 5120+11 652.99 MB 30 Sep 2011 - 23:41 Feedfetcher-Google 3113 21.21 MB 30 Sep 2011 - 23:42 Heritrix 2791+6 24.81 MB 08 Sep 2011 - 09:37 Unknown robot (identified by empty user agent string) 2554+5 676.44 MB 30 Sep 2011 - 23:57 Unknown robot (identified by 'spider') 2204+156 127.39 MB 30 Sep 2011 - 23:31 Exabot 1163+50 251.73 MB 30 Sep 2011 - 23:13 legs 771+238 114.55 MB 30 Sep 2011 - 04:50 Speedy Spider 501+149 19.41 MB 30 Sep 2011 - 20:20 MJ12bot 375+195 23.44 MB 30 Sep 2011 - 18:49 psbot 534+31 8.98 MB 28 Sep 2011 - 07:49 Unknown robot (identified by hit on 'robots.txt') 0+563 17.04 KB 30 Sep 2011 - 16:44 Unknown robot (identified by '*bot') 187+117 166.28 MB 30 Sep 2011 - 12:24 Jakarta commons-httpclient 291 700.55 MB 30 Sep 2011 - 20:06 Java (Often spam bot) 266+9 204.09 MB 30 Sep 2011 - 23:22 bender focused_crawler 234+6 279.35 MB 30 Sep 2011 - 23:42 FaceBook bot 192 2.83 MB 30 Sep 2011 - 06:55 Unknown robot (identified by 'discovery') 161+2 626.90 MB 30 Sep 2011 - 17:57 CFNetwork 141 556.65 MB 30 Sep 2011 - 15:00 OutfoxBot/YodaoBot 116+18 820.93 KB 29 Sep 2011 - 15:27 WordPress 124 42.04 MB 30 Sep 2011 - 07:14 Nutch 39+56 47.07 MB 29 Sep 2011 - 08:17 Alexa (IA Archiver) 47+42 1.65 MB 30 Sep 2011 - 17:24 WGet tools 77 222.16 MB 30 Sep 2011 - 18:08 DoCoMo 37+13 129.80 MB 29 Sep 2011 - 03:51 Motor 39 1.19 MB 16 Sep 2011 - 16:20 Findlinks 11+25 151.24 KB 30 Sep 2011 - 09:39 Harvest 34 756.50 KB 30 Sep 2011 - 16:15 EasyDL 29 770.66 KB 15 Sep 2011 - 18:37 Custo 22 780.10 KB 26 Sep 2011 - 18:16 Perl tool 19 219.00 KB 29 Sep 2011 - 21:10 Python-urllib 16 37.49 MB 30 Sep 2011 - 20:38 Y!J Yahoo Japan 4+12 669.59 KB 12 Sep 2011 - 20:44 Web Core / Roots 12 18.54 MB 07 Sep 2011 - 16:08 NG 1.x (Exalead) 12 7.12 MB 20 Sep 2011 - 12:48 ichiro 4+6 64.46 KB 28 Sep 2011 - 08:35 MSNBot 10 14.23 MB 23 Sep 2011 - 05:25 yacy 6+3 63.61 MB 10 Sep 2011 - 09:44 larbin 5+2 84.92 KB 07 Sep 2011 - 17:35 SeznamBot 3+3 21.31 KB 27 Sep 2011 - 00:42 Netcraft 5 28.29 KB 26 Sep 2011 - 20:06 archive.org bot 3+2 6.55 MB 26 Sep 2011 - 22:44 Mail.ru bot 3+1 11.30 MB 13 Sep 2011 - 14:35 GigaBot 2+2 34.59 KB 26 Sep 2011 - 14:10 Feedburner 4 0 20 Sep 2011 - 22:57 FavIconizer 4 28.29 KB 27 Sep 2011 - 16:06 Checkbot 4 0 29 Sep 2011 - 03:52 Fish search 3 62.56 KB 24 Sep 2011 - 03:16 LinkChecker 0+3 93 Bytes 29 Sep 2011 - 05:18 Combine System 2+1 34.41 KB 12 Sep 2011 - 13:37 BSpider 3 8.16 MB 23 Sep 2011 - 14:34 MSIECrawler 3 32.60 KB 19 Sep 2011 - 23:53 Unknown robot (identified by 'checker') 2 0 13 Sep 2011 - 11:24 Powermarks 2 26.29 KB 29 Sep 2011 - 14:21 MojeekBot 1+1 7.10 KB 15 Sep 2011 - 14:21 HTTrack off-line browser 1 7.34 MB 23 Sep 2011 - 11:14 BlogPulse ISSpider intelliseek.com 1 7.07 KB 24 Sep 2011 - 16:23 Accoona-AI-Agent 1 7.07 KB 20 Sep 2011 - 08:03 Unknown robot (identified by 'hunter') 1 50.00 KB 28 Sep 2011 - 13:04 Voyager 1 4.13 MB 28 Sep 2011 - 17:55 Araneo 0+1 31 Bytes 01 Sep 2011 - 01:13

* Robots shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts. Numbers after + are successful hits on "robots.txt" files.



Advanced Web Statistics 6.95 (build 1.943) - Created by awstats (plugins: geoip)