| 61 different robots | Hits | Bandwidth | Last visit |
|---|
| Yandex bot | 44609+73 | 17.28 GB | 31 Dec 2013 - 23:59 |
| Googlebot | 104986+738 | 154.05 GB | 31 Dec 2013 - 23:59 |
| BaiDuSpider | 8534+11 | 571.73 MB | 31 Dec 2013 - 23:59 |
| Unknown robot (identified by 'bot*') | 158943+1522 | 21.06 GB | 31 Dec 2013 - 23:59 |
| psbot | 1711+94 | 39.08 MB | 31 Dec 2013 - 23:56 |
| Unknown robot (identified by 'spider') | 9531+150 | 426.64 MB | 31 Dec 2013 - 23:54 |
| Unknown robot (identified by hit on 'robots.txt') | 0+502 | 42.16 KB | 31 Dec 2013 - 23:53 |
| Unknown robot (identified by 'robot') | 214+20 | 5.40 MB | 31 Dec 2013 - 23:49 |
| Feedfetcher-Google | 4769 | 399.42 MB | 31 Dec 2013 - 23:43 |
| MSNBot | 515+58 | 36.02 MB | 31 Dec 2013 - 23:35 |
| Sogou Spider | 21390+167 | 2.79 GB | 31 Dec 2013 - 23:34 |
| Mail.ru bot | 905+229 | 4.96 GB | 31 Dec 2013 - 22:53 |
| Unknown robot (identified by empty user agent string) | 1215 | 1.40 GB | 31 Dec 2013 - 22:46 |
| Exabot | 501+37 | 31.22 MB | 31 Dec 2013 - 21:40 |
| MJ12bot | 92+25 | 4.21 MB | 31 Dec 2013 - 21:25 |
| Jakarta commons-httpclient | 317+3 | 57.98 MB | 31 Dec 2013 - 20:54 |
| Harvest | 88 | 1.77 MB | 31 Dec 2013 - 19:47 |
| MSNBot-media | 325+385 | 79.51 MB | 31 Dec 2013 - 19:34 |
| Java (Often spam bot) | 786+9 | 199.28 MB | 31 Dec 2013 - 19:33 |
| Unknown robot (identified by 'crawl') | 6199+63 | 103.98 MB | 31 Dec 2013 - 18:14 |
| SeznamBot | 179+21 | 24.60 MB | 31 Dec 2013 - 17:51 |
| Yahoo Slurp | 3029+11 | 1.18 GB | 31 Dec 2013 - 16:10 |
| Python-urllib | 14+10 | 58.51 MB | 31 Dec 2013 - 16:10 |
| FavIconizer | 159 | 54.97 MB | 31 Dec 2013 - 14:35 |
| DoCoMo | 30+5 | 737.38 KB | 31 Dec 2013 - 14:35 |
| FaceBook bot | 523 | 19.36 MB | 31 Dec 2013 - 14:33 |
| Nutch | 213+39 | 26.17 MB | 31 Dec 2013 - 13:22 |
| Perl tool | 47 | 5.35 MB | 31 Dec 2013 - 13:22 |
| CFNetwork | 276 | 529.04 MB | 31 Dec 2013 - 11:16 |
| WGet tools | 197 | 665.60 MB | 31 Dec 2013 - 11:14 |
| Web Core / Roots | 58 | 1.48 MB | 31 Dec 2013 - 11:11 |
| archive.org bot | 106+22 | 13.11 MB | 31 Dec 2013 - 03:08 |
| MagpieRSS | 0+35 | 2.94 KB | 31 Dec 2013 - 01:42 |
| NG 2.x (Exalead) | 35 | 455.75 KB | 30 Dec 2013 - 12:05 |
| WebFilter | 33+29 | 499.06 KB | 29 Dec 2013 - 19:04 |
| BBot | 8 | 19.46 MB | 29 Dec 2013 - 15:18 |
| Alexa (IA Archiver) | 377+39 | 47.00 MB | 28 Dec 2013 - 13:23 |
| Checkbot | 6 | 0 | 28 Dec 2013 - 11:14 |
| HTTrack off-line browser | 5 | 118.06 KB | 27 Dec 2013 - 08:58 |
| Unknown robot (identified by '*bot') | 61+23 | 1.83 MB | 27 Dec 2013 - 08:35 |
| WordPress | 88 | 24.67 MB | 26 Dec 2013 - 22:03 |
| larbin | 35+6 | 4.68 MB | 26 Dec 2013 - 02:55 |
| ichiro | 5+1 | 39.94 KB | 24 Dec 2013 - 23:13 |
| NG 1.x (Exalead) | 35 | 9.74 MB | 24 Dec 2013 - 06:55 |
| Unknown robot (identified by 'checker') | 31 | 119.32 MB | 21 Dec 2013 - 12:39 |
| Y!J Yahoo Japan | 2+2 | 1.36 MB | 20 Dec 2013 - 08:06 |
| Unknown robot (identified by 'discovery') | 5 | 62.43 KB | 19 Dec 2013 - 05:59 |
| XYLEME Robot | 1 | 20.99 KB | 18 Dec 2013 - 21:50 |
| legs | 10+10 | 115.11 KB | 18 Dec 2013 - 12:34 |
| WebCollage | 1 | 253.55 KB | 17 Dec 2013 - 16:34 |
| Heritrix | 0+1 | 86 Bytes | 17 Dec 2013 - 06:39 |
| MSIECrawler | 2 | 46.35 KB | 16 Dec 2013 - 15:56 |
| TITAN | 1 | 12.73 KB | 16 Dec 2013 - 12:53 |
| MojeekBot | 1+1 | 16.63 KB | 16 Dec 2013 - 04:40 |
| Turn It In | 27+23 | 5.67 MB | 15 Dec 2013 - 12:26 |
| LinkChecker | 2+1 | 8.49 KB | 12 Dec 2013 - 07:53 |
| Phantom | 22 | 5.97 MB | 11 Dec 2013 - 18:28 |
| Netcraft | 1 | 8.41 KB | 10 Dec 2013 - 14:44 |
| LinkBot | 1 | 2.72 MB | 09 Dec 2013 - 08:36 |
| VSE | 0+1 | 86 Bytes | 07 Dec 2013 - 11:48 |
| yacy | 1 | 362.26 KB | 02 Dec 2013 - 12:03 |