60 different robots | Hits | Bandwidth | Last visit |
Googlebot | 149975+719 | 113.91 GB | 30 Jun 2013 - 23:59 |
Unknown robot (identified by 'bot*') | 88041+1080 | 18.04 GB | 30 Jun 2013 - 23:57 |
Exabot | 13405+40 | 339.92 MB | 30 Jun 2013 - 23:58 |
BaiDuSpider | 11234 | 2.88 GB | 30 Jun 2013 - 23:59 |
BSpider | 10844+15 | 5.59 GB | 30 Jun 2013 - 23:03 |
Sogou Spider | 10253+105 | 916.00 MB | 30 Jun 2013 - 22:43 |
Unknown robot (identified by 'crawl') | 7548+34 | 76.01 MB | 30 Jun 2013 - 12:38 |
Feedfetcher-Google | 5639 | 533.64 MB | 30 Jun 2013 - 23:57 |
Yandex bot | 4628+58 | 3.78 GB | 30 Jun 2013 - 23:43 |
Unknown robot (identified by 'spider') | 3196+89 | 3.67 GB | 30 Jun 2013 - 23:52 |
psbot | 2711+106 | 67.75 MB | 30 Jun 2013 - 20:39 |
Yahoo Slurp | 1620+4 | 88.56 MB | 30 Jun 2013 - 20:35 |
Unknown robot (identified by empty user agent string) | 1362+4 | 7.11 GB | 30 Jun 2013 - 23:00 |
LinkChecker | 1041+3 | 11.92 MB | 25 Jun 2013 - 10:14 |
FaceBook bot | 1035 | 65.45 MB | 30 Jun 2013 - 00:42 |
Java (Often spam bot) | 640+1 | 1.29 GB | 30 Jun 2013 - 20:08 |
Unknown robot (identified by hit on 'robots.txt') | 0+608 | 51.06 KB | 30 Jun 2013 - 23:52 |
yacy | 424+26 | 96.62 MB | 28 Jun 2013 - 07:05 |
Unknown robot (identified by 'robot') | 432+18 | 22.02 MB | 30 Jun 2013 - 16:42 |
Nutch | 374+31 | 46.02 MB | 27 Jun 2013 - 15:03 |
MJ12bot | 327+77 | 15.29 MB | 29 Jun 2013 - 07:10 |
MSNBot-media | 85+226 | 46.68 MB | 30 Jun 2013 - 16:25 |
Jakarta commons-httpclient | 259+8 | 31.94 MB | 30 Jun 2013 - 20:52 |
Unknown robot (identified by '*bot') | 129+134 | 3.33 MB | 30 Jun 2013 - 23:58 |
MSNBot | 232+22 | 32.66 MB | 30 Jun 2013 - 19:29 |
CFNetwork | 199 | 855.96 MB | 30 Jun 2013 - 23:21 |
WebFilter | 136+18 | 3.10 MB | 30 Jun 2013 - 04:13 |
Phantom | 137 | 15.94 MB | 27 Jun 2013 - 18:17 |
Alexa (IA Archiver) | 68+58 | 7.20 MB | 30 Jun 2013 - 18:10 |
Harvest | 89 | 2.59 MB | 30 Jun 2013 - 11:07 |
WGet tools | 77+1 | 1.17 GB | 30 Jun 2013 - 12:25 |
larbin | 63+7 | 8.80 MB | 30 Jun 2013 - 12:56 |
DoCoMo | 53+13 | 1.12 MB | 30 Jun 2013 - 19:54 |
SeznamBot | 42+13 | 3.48 MB | 29 Jun 2013 - 21:19 |
MagpieRSS | 6+42 | 131.58 KB | 30 Jun 2013 - 23:03 |
OutfoxBot/YodaoBot | 42 | 349.17 KB | 25 Jun 2013 - 11:24 |
NG 1.x (Exalead) | 41 | 4.56 MB | 30 Jun 2013 - 09:59 |
Web Core / Roots | 41 | 40.81 MB | 27 Jun 2013 - 15:50 |
archive.org bot | 33+6 | 47.92 MB | 21 Jun 2013 - 05:54 |
Perl tool | 35 | 20.44 MB | 30 Jun 2013 - 04:33 |
WordPress | 31 | 26.61 MB | 27 Jun 2013 - 22:43 |
Turn It In | 9+8 | 1.55 MB | 27 Jun 2013 - 08:26 |
Y!J Yahoo Japan | 6+6 | 40.11 MB | 21 Jun 2013 - 04:41 |
HTTrack off-line browser | 12 | 3.08 MB | 23 Jun 2013 - 05:24 |
legs | 6+3 | 50.13 KB | 24 Jun 2013 - 23:04 |
Python-urllib | 3+5 | 21.34 MB | 27 Jun 2013 - 05:07 |
Mail.ru bot | 4+3 | 1.11 MB | 25 Jun 2013 - 18:46 |
Unknown robot (identified by 'discovery') | 6 | 40.12 KB | 21 Jun 2013 - 03:00 |
FavIconizer | 6 | 49.88 KB | 25 Jun 2013 - 18:07 |
Google AdSense | 5 | 124.26 KB | 24 Jun 2013 - 16:51 |
WebCollage | 5 | 985.59 KB | 29 Jun 2013 - 17:40 |
Findlinks | 3+2 | 50.76 KB | 25 Jun 2013 - 00:32 |
Checkbot | 4 | 0 | 27 Jun 2013 - 04:38 |
WallPaper (alias crawlpaper) | 1 | 9.03 KB | 29 Jun 2013 - 03:39 |
W3C Validator | 1 | 6.17 MB | 13 Jun 2013 - 01:35 |
StackRambler | 1 | 3.79 MB | 06 Jun 2013 - 05:40 |
BBot | 1 | 495.60 KB | 06 Jun 2013 - 17:31 |
MSIECrawler | 1 | 8.31 KB | 16 Jun 2013 - 14:42 |
Netcraft | 1 | 8.31 KB | 07 Jun 2013 - 19:53 |
ichiro | 0+1 | 86 Bytes | 17 Jun 2013 - 14:51 |