70 different robots | Hits | Bandwidth | Last visit |
Yandex bot | 34636+82 | 33.66 GB | 30 Sep 2012 - 23:59 |
Unknown robot (identified by 'spider') | 20153+139 | 20.35 GB | 30 Sep 2012 - 23:59 |
BaiDuSpider | 24434+189 | 6.64 GB | 30 Sep 2012 - 23:59 |
Googlebot | 119039+125 | 52.69 GB | 30 Sep 2012 - 23:59 |
Unknown robot (identified by 'bot*') | 92927+641 | 125.89 GB | 30 Sep 2012 - 23:59 |
Exabot | 11920+57 | 9.32 GB | 30 Sep 2012 - 23:58 |
Sogou Spider | 13826+23 | 1.01 GB | 30 Sep 2012 - 23:54 |
BSpider | 609+57 | 17.20 MB | 30 Sep 2012 - 23:51 |
Perl tool | 21+1 | 23.73 MB | 30 Sep 2012 - 23:49 |
Feedfetcher-Google | 3691 | 26.77 MB | 30 Sep 2012 - 23:48 |
Unknown robot (identified by hit on 'robots.txt') | 0+534 | 16.17 KB | 30 Sep 2012 - 23:18 |
Unknown robot (identified by 'crawl') | 19337+738 | 12.48 GB | 30 Sep 2012 - 23:18 |
Nutch | 256+46 | 46.65 MB | 30 Sep 2012 - 23:08 |
Java (Often spam bot) | 1044+10 | 125.05 MB | 30 Sep 2012 - 22:48 |
CFNetwork | 353 | 373.13 MB | 30 Sep 2012 - 22:30 |
Unknown robot (identified by empty user agent string) | 1260+163 | 3.51 GB | 30 Sep 2012 - 22:08 |
MSNBot | 457+31 | 114.40 MB | 30 Sep 2012 - 21:07 |
Yahoo Slurp | 2629+28 | 126.78 MB | 30 Sep 2012 - 20:29 |
OutfoxBot/YodaoBot | 150+132 | 1.03 MB | 30 Sep 2012 - 20:18 |
Unknown robot (identified by '*bot') | 100+248 | 8.62 MB | 30 Sep 2012 - 19:52 |
Alexa (IA Archiver) | 191+151 | 71.06 MB | 30 Sep 2012 - 19:31 |
WordPress | 305 | 91.21 MB | 30 Sep 2012 - 18:06 |
DoCoMo | 27+27 | 454.62 KB | 30 Sep 2012 - 17:40 |
MJ12bot | 298+109 | 20.71 MB | 30 Sep 2012 - 16:57 |
FaceBook bot | 499 | 9.67 MB | 30 Sep 2012 - 14:51 |
Jakarta commons-httpclient | 110 | 36.24 MB | 30 Sep 2012 - 13:45 |
NG 1.x (Exalead) | 201 | 1.41 MB | 30 Sep 2012 - 13:42 |
WGet tools | 45+4 | 155.07 MB | 30 Sep 2012 - 13:14 |
MSNBot-media | 38+29 | 1.08 MB | 30 Sep 2012 - 10:57 |
Unknown robot (identified by 'robot') | 842+20 | 1.19 GB | 30 Sep 2012 - 08:54 |
Harvest | 25 | 673.85 KB | 30 Sep 2012 - 08:52 |
legs | 195+62 | 121.75 MB | 30 Sep 2012 - 07:08 |
WebFilter | 61 | 639.66 KB | 30 Sep 2012 - 07:00 |
yacy | 151+3 | 128.15 MB | 30 Sep 2012 - 02:27 |
larbin | 5+3 | 11.33 MB | 30 Sep 2012 - 01:24 |
ExactSeek Crawler | 1 | 6.99 KB | 29 Sep 2012 - 18:19 |
Python-urllib | 3+26 | 11.25 MB | 29 Sep 2012 - 17:09 |
Mail.ru bot | 334+12 | 940.89 MB | 28 Sep 2012 - 19:01 |
Unknown robot (identified by 'discovery') | 18361+18 | 28.72 GB | 28 Sep 2012 - 16:44 |
psbot | 1441+45 | 29.40 MB | 28 Sep 2012 - 16:24 |
Findlinks | 8+3 | 181.44 KB | 28 Sep 2012 - 14:37 |
SeznamBot | 34+12 | 11.78 MB | 27 Sep 2012 - 23:08 |
Checkbot | 4 | 0 | 27 Sep 2012 - 04:04 |
Phantom | 1 | 5.67 MB | 25 Sep 2012 - 22:06 |
Web Core / Roots | 23 | 611.85 KB | 25 Sep 2012 - 18:13 |
Unknown robot (identified by 'checker') | 2 | 0 | 25 Sep 2012 - 15:02 |
MagpieRSS | 0+9 | 279 Bytes | 25 Sep 2012 - 09:46 |
FavIconizer | 2 | 13.99 KB | 25 Sep 2012 - 08:26 |
Mirago | 1 | 6.99 KB | 24 Sep 2012 - 20:18 |
Y!J Yahoo Japan | 26+26 | 19.96 MB | 23 Sep 2012 - 05:29 |
UCSD Crawl | 1 | 110.50 KB | 22 Sep 2012 - 17:00 |
Motor | 25 | 15.26 MB | 22 Sep 2012 - 02:06 |
bender focused_crawler | 122+6 | 214.49 MB | 20 Sep 2012 - 04:40 |
ichiro | 8+8 | 120.66 KB | 18 Sep 2012 - 16:09 |
archive.org bot | 33+6 | 73.02 MB | 16 Sep 2012 - 14:32 |
HTMLParser | 11 | 453.30 KB | 13 Sep 2012 - 00:32 |
W3C Validator | 1 | 7.20 MB | 12 Sep 2012 - 07:22 |
HTTrack off-line browser | 2 | 6.78 MB | 11 Sep 2012 - 20:46 |
WebCollage | 2 | 13.45 KB | 11 Sep 2012 - 05:42 |
Webdup | 1 | 6.99 KB | 10 Sep 2012 - 22:17 |
Voila | 0+1 | 31 Bytes | 10 Sep 2012 - 03:09 |
Heritrix | 10+5 | 233.32 KB | 10 Sep 2012 - 03:00 |
Alkaline | 1 | 6.99 KB | 09 Sep 2012 - 12:22 |
ASpider (Associative Spider) | 1 | 21.45 KB | 09 Sep 2012 - 02:55 |
Netcraft | 5 | 27.98 KB | 08 Sep 2012 - 23:52 |
Grub.org | 1 | 19.93 KB | 03 Sep 2012 - 06:10 |
StackRambler | 1 | 509.72 KB | 03 Sep 2012 - 01:43 |
Fast-Webcrawler | 1 | 6.99 KB | 02 Sep 2012 - 18:19 |
Fish search | 3 | 3.63 MB | 02 Sep 2012 - 16:24 |
MSIECrawler | 1 | 6.99 KB | 01 Sep 2012 - 10:38 |