63 different robots | Hits | Bandwidth | Last visit |
Feedfetcher-Google | 4894 | 419.64 MB | 31 Mar 2014 - 23:59 |
Googlebot | 108276+777 | 145.44 GB | 31 Mar 2014 - 23:59 |
Unknown robot (identified by 'spider') | 6483+96 | 292.57 MB | 31 Mar 2014 - 23:58 |
BaiDuSpider | 8885+43 | 1.40 GB | 31 Mar 2014 - 23:56 |
Unknown robot (identified by 'bot*') | 134569+588 | 17.24 GB | 31 Mar 2014 - 23:53 |
Yandex bot | 32680+74 | 67.83 GB | 31 Mar 2014 - 23:52 |
Yahoo Slurp | 16693+46 | 4.17 GB | 31 Mar 2014 - 23:51 |
Turn It In | 2+2 | 25.12 KB | 31 Mar 2014 - 23:42 |
Sogou Spider | 6314+109 | 2.57 GB | 31 Mar 2014 - 23:26 |
Java (Often spam bot) | 1393+28 | 515.48 MB | 31 Mar 2014 - 23:14 |
archive.org bot | 25+18 | 11.38 MB | 31 Mar 2014 - 22:52 |
Nutch | 671+471 | 17.76 MB | 31 Mar 2014 - 22:42 |
Mail.ru bot | 2254+213 | 5.48 GB | 31 Mar 2014 - 22:35 |
FaceBook bot | 471 | 24.21 MB | 31 Mar 2014 - 22:31 |
Unknown robot (identified by hit on 'robots.txt') | 0+707 | 59.38 KB | 31 Mar 2014 - 22:04 |
WGet tools | 388+3 | 653.07 MB | 31 Mar 2014 - 21:58 |
Unknown robot (identified by empty user agent string) | 1684+6 | 698.53 MB | 31 Mar 2014 - 21:36 |
Exabot | 722+48 | 22.91 MB | 31 Mar 2014 - 21:11 |
Jakarta commons-httpclient | 246+6 | 42.34 MB | 31 Mar 2014 - 20:44 |
Unknown robot (identified by 'crawl') | 16699+728 | 336.44 MB | 31 Mar 2014 - 20:03 |
W3C Link Checker | 1+1 | 86 Bytes | 31 Mar 2014 - 19:09 |
Unknown robot (identified by 'discovery') | 16 | 121.17 KB | 31 Mar 2014 - 19:09 |
WebFilter | 107+41 | 1.57 MB | 31 Mar 2014 - 19:04 |
larbin | 13+4 | 158.62 KB | 31 Mar 2014 - 16:59 |
psbot | 382+46 | 8.47 MB | 31 Mar 2014 - 16:11 |
CFNetwork | 397 | 792.84 MB | 31 Mar 2014 - 14:33 |
FavIconizer | 182 | 30.88 MB | 31 Mar 2014 - 14:00 |
SeznamBot | 45+21 | 1.19 MB | 31 Mar 2014 - 13:28 |
Unknown robot (identified by 'robot') | 178+28 | 10.86 MB | 31 Mar 2014 - 09:32 |
Unknown robot (identified by '*bot') | 341+70 | 47.70 MB | 31 Mar 2014 - 08:51 |
MSNBot-media | 163+123 | 108.83 MB | 31 Mar 2014 - 03:43 |
MagpieRSS | 0+37 | 3.11 KB | 31 Mar 2014 - 03:06 |
MJ12bot | 147+74 | 11.78 MB | 31 Mar 2014 - 01:51 |
MSNBot | 162+59 | 18.90 MB | 31 Mar 2014 - 01:02 |
Perl tool | 55 | 11.02 MB | 30 Mar 2014 - 20:24 |
Alexa (IA Archiver) | 72+52 | 17.89 MB | 30 Mar 2014 - 19:07 |
WordPress | 71 | 24.26 MB | 30 Mar 2014 - 19:00 |
NG 1.x (Exalead) | 22 | 17.41 MB | 30 Mar 2014 - 08:11 |
Web Core / Roots | 69 | 769.24 KB | 29 Mar 2014 - 23:34 |
Harvest | 121+1 | 28.45 MB | 29 Mar 2014 - 20:35 |
Google AdSense | 2 | 42.36 KB | 29 Mar 2014 - 17:44 |
Python-urllib | 23+24 | 47.72 MB | 29 Mar 2014 - 06:58 |
yacy | 171+4 | 13.08 MB | 29 Mar 2014 - 02:46 |
Heritrix | 4+2 | 48.67 KB | 28 Mar 2014 - 16:13 |
StackRambler | 97 | 20.44 MB | 27 Mar 2014 - 05:53 |
Checkbot | 6 | 0 | 27 Mar 2014 - 04:19 |
VORTEX | 2 | 13.87 KB | 27 Mar 2014 - 02:47 |
WebCollage | 1 | 130.98 KB | 24 Mar 2014 - 15:27 |
TITAN | 1 | 48.33 MB | 24 Mar 2014 - 15:09 |
Raven Search | 1 | 0 | 22 Mar 2014 - 23:09 |
Steeler | 19+8 | 416.95 KB | 21 Mar 2014 - 19:21 |
MSIECrawler | 1 | 8.41 KB | 20 Mar 2014 - 15:55 |
HTTrack off-line browser | 8+2 | 14.27 MB | 18 Mar 2014 - 22:58 |
Phantom | 7 | 2.57 MB | 18 Mar 2014 - 10:17 |
Fish search | 17 | 1.19 MB | 17 Mar 2014 - 03:22 |
lwp-trivial | 1 | 18.30 KB | 16 Mar 2014 - 08:11 |
VSE | 0+1 | 86 Bytes | 13 Mar 2014 - 18:42 |
NG 2.x (Exalead) | 17 | 1.17 MB | 12 Mar 2014 - 14:00 |
Netcraft | 1 | 8.41 KB | 10 Mar 2014 - 10:47 |
the World Wide Web Wanderer | 2 | 8.41 KB | 09 Mar 2014 - 15:41 |
BBot | 2 | 35.10 KB | 06 Mar 2014 - 19:36 |
legs | 61+13 | 514.05 KB | 05 Mar 2014 - 14:43 |
DoCoMo | 1+1 | 26.54 KB | 01 Mar 2014 - 02:19 |