60 different robots | Hits | Bandwidth | Last visit |
Googlebot | 152949+743 | 107.32 GB | 31 Mar 2013 - 23:59 |
Unknown robot (identified by 'bot*') | 89188+213 | 12.06 GB | 31 Mar 2013 - 23:59 |
Yandex bot | 40091+127 | 13.45 GB | 31 Mar 2013 - 23:28 |
Sogou Spider | 17526+130 | 1.06 GB | 31 Mar 2013 - 23:58 |
Exabot | 13743+37 | 358.50 MB | 31 Mar 2013 - 23:59 |
Unknown robot (identified by 'spider') | 7187+19 | 3.48 GB | 31 Mar 2013 - 23:40 |
BaiDuSpider | 6116 | 231.76 MB | 31 Mar 2013 - 23:57 |
MSNBot | 5572+52 | 157.02 MB | 31 Mar 2013 - 13:44 |
Unknown robot (identified by 'robot') | 4357+16 | 94.21 MB | 31 Mar 2013 - 22:43 |
Feedfetcher-Google | 4305 | 292.18 MB | 31 Mar 2013 - 23:46 |
Yahoo Slurp | 2435+15 | 131.06 MB | 31 Mar 2013 - 09:48 |
Mail.ru bot | 2360+6 | 695.52 MB | 19 Mar 2013 - 10:38 |
psbot | 2171+108 | 50.35 MB | 31 Mar 2013 - 23:33 |
BSpider | 891+21 | 97.58 MB | 31 Mar 2013 - 21:54 |
Unknown robot (identified by hit on 'robots.txt') | 0+735 | 61.73 KB | 31 Mar 2013 - 23:16 |
Nutch | 661+39 | 38.75 MB | 30 Mar 2013 - 19:42 |
Unknown robot (identified by empty user agent string) | 632+5 | 255.98 MB | 31 Mar 2013 - 22:33 |
Unknown robot (identified by 'crawl') | 478+83 | 81.19 MB | 31 Mar 2013 - 19:34 |
MSNBot-media | 92+350 | 19.86 MB | 31 Mar 2013 - 23:14 |
Java (Often spam bot) | 429+1 | 112.01 MB | 31 Mar 2013 - 21:08 |
FaceBook bot | 415 | 19.28 MB | 29 Mar 2013 - 16:43 |
DoCoMo | 378+21 | 8.53 MB | 31 Mar 2013 - 09:38 |
CFNetwork | 335 | 806.48 MB | 31 Mar 2013 - 00:45 |
Unknown robot (identified by '*bot') | 134+139 | 3.25 MB | 31 Mar 2013 - 22:30 |
WGet tools | 271+2 | 284.01 MB | 31 Mar 2013 - 14:18 |
MJ12bot | 163+65 | 11.88 MB | 31 Mar 2013 - 18:46 |
Jakarta commons-httpclient | 209 | 56.86 MB | 31 Mar 2013 - 18:06 |
Alexa (IA Archiver) | 111+91 | 29.22 MB | 31 Mar 2013 - 20:44 |
Harvest | 178 | 25.67 MB | 31 Mar 2013 - 02:04 |
WebFilter | 130+29 | 2.98 MB | 30 Mar 2013 - 16:40 |
yacy | 141+2 | 49.25 MB | 16 Mar 2013 - 08:24 |
NG 1.x (Exalead) | 67 | 786.18 KB | 31 Mar 2013 - 09:40 |
WordPress | 48 | 31.38 MB | 29 Mar 2013 - 19:23 |
SeznamBot | 33+10 | 8.96 MB | 29 Mar 2013 - 20:55 |
Phantom | 34 | 1.83 MB | 29 Mar 2013 - 01:26 |
Perl tool | 22 | 11.42 MB | 30 Mar 2013 - 08:57 |
Web Core / Roots | 21 | 7.07 MB | 28 Mar 2013 - 23:15 |
MagpieRSS | 0+21 | 1.76 KB | 31 Mar 2013 - 02:48 |
Python-urllib | 16+4 | 26.48 MB | 31 Mar 2013 - 20:26 |
OutfoxBot/YodaoBot | 19 | 157.96 KB | 16 Mar 2013 - 08:38 |
VORTEX | 17 | 956.82 KB | 09 Mar 2013 - 17:56 |
Unknown robot (identified by 'discovery') | 11+1 | 85.56 KB | 29 Mar 2013 - 08:13 |
Y!J Yahoo Japan | 5+5 | 7.11 MB | 18 Mar 2013 - 02:12 |
legs | 5+4 | 41.90 KB | 26 Mar 2013 - 10:09 |
Combine System | 4+3 | 50.05 KB | 27 Mar 2013 - 07:57 |
WebCollage | 6 | 462.17 KB | 26 Mar 2013 - 07:22 |
Checkbot | 4 | 0 | 28 Mar 2013 - 04:16 |
Custo | 0+4 | 344 Bytes | 31 Mar 2013 - 02:30 |
Findlinks | 2+2 | 12.60 KB | 18 Mar 2013 - 22:42 |
FavIconizer | 4 | 33.25 KB | 21 Mar 2013 - 14:52 |
Girafabot | 3 | 31.18 KB | 27 Mar 2013 - 02:56 |
HTTrack off-line browser | 2+1 | 52.98 KB | 26 Mar 2013 - 16:06 |
archive.org bot | 2+1 | 10.85 MB | 02 Mar 2013 - 15:35 |
larbin | 2+1 | 34.85 KB | 30 Mar 2013 - 03:26 |
LinkChecker | 1+1 | 86 Bytes | 14 Mar 2013 - 05:16 |
ActiveBookmark | 2 | 594 Bytes | 06 Mar 2013 - 02:50 |
Heritrix | 1+1 | 2.04 MB | 17 Mar 2013 - 05:19 |
WallPaper (alias crawlpaper) | 1 | 8.56 KB | 15 Mar 2013 - 18:40 |
Voila | 0+1 | 86 Bytes | 28 Mar 2013 - 19:56 |
Netcraft | 1 | 8.31 KB | 08 Mar 2013 - 18:48 |