82 different robots | Hits | Bandwidth | Last visit |
Googlebot | 125167+743 | 48.88 GB | 31 Jan 2013 - 23:59 |
BaiDuSpider | 7361 | 1.81 GB | 31 Jan 2013 - 23:59 |
Sogou Spider | 15303+116 | 1.17 GB | 31 Jan 2013 - 23:58 |
Feedfetcher-Google | 4710 | 299.59 MB | 31 Jan 2013 - 23:58 |
Exabot | 10048+44 | 303.22 MB | 31 Jan 2013 - 23:57 |
Yandex bot | 30902+107 | 29.26 GB | 31 Jan 2013 - 23:50 |
MagpieRSS | 0+19 | 1.60 KB | 31 Jan 2013 - 23:46 |
legs | 76+33 | 679.79 KB | 31 Jan 2013 - 23:45 |
Yahoo Slurp | 4745+20 | 301.24 MB | 31 Jan 2013 - 23:43 |
psbot | 607+57 | 22.74 MB | 31 Jan 2013 - 23:43 |
Unknown robot (identified by 'bot*') | 176090+400 | 17.27 GB | 31 Jan 2013 - 23:32 |
Unknown robot (identified by '*bot') | 113+153 | 2.73 MB | 31 Jan 2013 - 23:29 |
Unknown robot (identified by hit on 'robots.txt') | 0+829 | 69.62 KB | 31 Jan 2013 - 23:26 |
MSNBot-media | 390+2326 | 712.24 MB | 31 Jan 2013 - 23:24 |
BSpider | 616+22 | 29.06 MB | 31 Jan 2013 - 23:23 |
WGet tools | 91+1 | 611.42 MB | 31 Jan 2013 - 23:14 |
Nutch | 50+30 | 39.93 MB | 31 Jan 2013 - 23:11 |
Unknown robot (identified by 'crawl') | 13761+124 | 4.53 GB | 31 Jan 2013 - 23:03 |
Unknown robot (identified by 'spider') | 7447+41 | 7.91 GB | 31 Jan 2013 - 22:42 |
Mail.ru bot | 2936+8 | 1.65 GB | 31 Jan 2013 - 22:32 |
WebFilter | 106+16 | 2.54 MB | 31 Jan 2013 - 21:53 |
Java (Often spam bot) | 2700 | 173.71 MB | 31 Jan 2013 - 20:48 |
FaceBook bot | 843+1 | 19.12 MB | 31 Jan 2013 - 19:54 |
Unknown robot (identified by empty user agent string) | 466+43 | 220.00 MB | 31 Jan 2013 - 19:53 |
yacy | 316+3 | 130.58 MB | 31 Jan 2013 - 19:37 |
Jakarta commons-httpclient | 198+4 | 48.33 MB | 31 Jan 2013 - 18:07 |
Alexa (IA Archiver) | 217+106 | 39.01 MB | 31 Jan 2013 - 17:44 |
NG 1.x (Exalead) | 2016 | 4.32 GB | 31 Jan 2013 - 15:08 |
MSNBot | 791+34 | 52.12 MB | 31 Jan 2013 - 14:01 |
Perl tool | 27 | 16.73 MB | 31 Jan 2013 - 07:22 |
MJ12bot | 187+51 | 15.80 MB | 31 Jan 2013 - 06:28 |
SeznamBot | 41+18 | 5.21 MB | 31 Jan 2013 - 05:16 |
Checkbot | 8 | 8.31 KB | 31 Jan 2013 - 04:03 |
WordPress | 31 | 6.09 MB | 31 Jan 2013 - 03:25 |
Python-urllib | 7402+6 | 162.79 MB | 31 Jan 2013 - 02:57 |
Unknown robot (identified by 'robot') | 330+50 | 36.68 MB | 31 Jan 2013 - 00:40 |
Motor | 31 | 2.38 MB | 30 Jan 2013 - 18:12 |
Harvest | 95 | 26.03 MB | 30 Jan 2013 - 18:00 |
W3C Link Checker | 10+5 | 430 Bytes | 30 Jan 2013 - 11:35 |
FavIconizer | 3 | 24.94 KB | 30 Jan 2013 - 10:00 |
Combine System | 9+1 | 10.39 MB | 29 Jan 2013 - 18:03 |
Findlinks | 7+7 | 78.18 KB | 29 Jan 2013 - 14:29 |
CFNetwork | 280 | 672.97 MB | 29 Jan 2013 - 12:27 |
WebCollage | 1 | 7.54 KB | 28 Jan 2013 - 23:39 |
DoCoMo | 57+28 | 867.24 KB | 28 Jan 2013 - 15:58 |
Turn It In | 5+7 | 2.81 MB | 28 Jan 2013 - 09:44 |
Powermarks | 1 | 51.38 KB | 28 Jan 2013 - 05:07 |
Unknown robot (identified by 'discovery') | 10 | 0 | 28 Jan 2013 - 01:14 |
WebReaper | 3+1 | 375.55 KB | 27 Jan 2013 - 14:03 |
OutfoxBot/YodaoBot | 36 | 299.29 KB | 27 Jan 2013 - 06:06 |
Custo | 0+1 | 86 Bytes | 27 Jan 2013 - 04:34 |
Phantom | 66 | 3.66 MB | 26 Jan 2013 - 11:36 |
archive.org bot | 49+6 | 12.47 MB | 26 Jan 2013 - 10:37 |
StackRambler | 3 | 61.02 MB | 26 Jan 2013 - 04:54 |
ASPseek | 1 | 8.31 KB | 24 Jan 2013 - 10:37 |
Y!J Yahoo Japan | 2+3 | 2.26 MB | 22 Jan 2013 - 10:59 |
Asterias | 1 | 8.31 KB | 22 Jan 2013 - 09:45 |
LinkChecker | 3+1 | 31.89 KB | 21 Jan 2013 - 23:31 |
MSIECrawler | 0+1 | 86 Bytes | 20 Jan 2013 - 11:14 |
Monster | 1 | 24.00 KB | 19 Jan 2013 - 08:30 |
Pogodak.com | 1 | 19.60 KB | 18 Jan 2013 - 07:37 |
Vagabondo | 1 | 24.72 KB | 18 Jan 2013 - 03:55 |
NimbleCrawler | 1 | 24.37 KB | 17 Jan 2013 - 09:54 |
Crawl libcrawl | 1 | 8.31 KB | 15 Jan 2013 - 08:50 |
larbin | 2+1 | 34.85 KB | 14 Jan 2013 - 21:28 |
ichiro | 0+1 | 86 Bytes | 14 Jan 2013 - 14:35 |
Digout4u | 1 | 8.31 KB | 13 Jan 2013 - 23:33 |
W3C Validator | 1 | 8.31 KB | 11 Jan 2013 - 14:53 |
Steeler | 11+3 | 319.19 KB | 11 Jan 2013 - 10:17 |
ZyBorg | 2 | 57.32 KB | 10 Jan 2013 - 23:20 |
Girafabot | 1 | 6.24 KB | 09 Jan 2013 - 10:52 |
Voila | 0+1 | 86 Bytes | 08 Jan 2013 - 07:24 |
Fast-Webcrawler | 1 | 8.31 KB | 07 Jan 2013 - 13:05 |
Sunrise | 2 | 2.16 KB | 07 Jan 2013 - 11:42 |
Netcraft | 1 | 8.31 KB | 07 Jan 2013 - 09:27 |
UdmSearch | 1 | 43.91 KB | 05 Jan 2013 - 10:04 |
Araneo | 0+1 | 86 Bytes | 04 Jan 2013 - 18:51 |
Yahoo! Japan keyoshid robot study | 1 | 22.32 KB | 03 Jan 2013 - 14:32 |
Web Core / Roots | 1 | 0 | 03 Jan 2013 - 11:55 |
JoBo Java Web Robot | 2 | 8.87 KB | 02 Jan 2013 - 14:12 |
Fish search | 1 | 15.79 KB | 02 Jan 2013 - 14:12 |
FastCrawler | 1 | 20.17 KB | 01 Jan 2013 - 18:23 |