| 68 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'bot*') | 140480+744 | 16.18 GB | 30 Nov 2014 - 23:59 |
| BaiDuSpider | 32748+15 | 36.21 GB | 30 Nov 2014 - 23:59 |
| Yandex bot | 28833+85 | 40.40 GB | 30 Nov 2014 - 23:59 |
| Googlebot | 96966+736 | 130.09 GB | 30 Nov 2014 - 23:58 |
| Nagios | 14422 | 122.49 MB | 30 Nov 2014 - 23:57 |
| Yahoo Slurp | 52167+45 | 13.68 GB | 30 Nov 2014 - 23:56 |
| Feedfetcher-Google | 3998 | 316.10 MB | 30 Nov 2014 - 23:56 |
| Unknown robot (identified by 'robot') | 144+66 | 66.09 MB | 30 Nov 2014 - 23:45 |
| Exabot | 590+45 | 18.50 MB | 30 Nov 2014 - 23:34 |
| Unknown robot (identified by empty user agent string) | 8933+7 | 1.26 GB | 30 Nov 2014 - 22:57 |
| Unknown robot (identified by 'spider') | 947+58 | 121.17 MB | 30 Nov 2014 - 22:46 |
| FaceBook bot | 907 | 105.03 MB | 30 Nov 2014 - 22:40 |
| archive.org bot | 49+19 | 258.82 KB | 30 Nov 2014 - 22:28 |
| Perl tool | 164 | 16.62 MB | 30 Nov 2014 - 22:12 |
| Unknown robot (identified by 'discovery') | 12 | 249.13 KB | 30 Nov 2014 - 21:42 |
| Java (Often spam bot) | 648+3 | 2.02 GB | 30 Nov 2014 - 20:28 |
| Jakarta commons-httpclient | 87+6 | 3.92 MB | 30 Nov 2014 - 19:23 |
| Heritrix | 47+4 | 109.50 MB | 30 Nov 2014 - 19:12 |
| BBot | 6 | 186.60 KB | 30 Nov 2014 - 19:00 |
| WebFilter | 51+22 | 11.16 MB | 30 Nov 2014 - 18:32 |
| Sift | 64 | 1.38 MB | 30 Nov 2014 - 17:58 |
| Sogou Spider | 4201+128 | 958.10 MB | 30 Nov 2014 - 14:54 |
| FavIconizer | 180 | 86.30 MB | 30 Nov 2014 - 13:56 |
| WordPress | 235 | 12.59 MB | 30 Nov 2014 - 13:05 |
| Alexa (IA Archiver) | 149+80 | 46.17 MB | 30 Nov 2014 - 13:04 |
| BetaBot | 2+3 | 98.37 KB | 30 Nov 2014 - 12:23 |
| Python-urllib | 799+22 | 2.00 GB | 30 Nov 2014 - 11:14 |
| NewsGator Online | 26 | 3.27 MB | 30 Nov 2014 - 10:57 |
| Unknown robot (identified by 'crawl') | 24979+210 | 529.20 MB | 30 Nov 2014 - 10:43 |
| SeznamBot | 68+42 | 293.68 KB | 30 Nov 2014 - 10:40 |
| CFNetwork | 180 | 672.93 MB | 30 Nov 2014 - 10:37 |
| Unknown robot (identified by hit on 'robots.txt') | 0+556 | 46.70 KB | 30 Nov 2014 - 08:53 |
| WGet tools | 17+4 | 247.04 MB | 30 Nov 2014 - 05:27 |
| MJ12bot | 228+70 | 20.42 MB | 30 Nov 2014 - 04:44 |
| DoCoMo | 5+6 | 86.49 KB | 30 Nov 2014 - 02:39 |
| yacy | 249+10 | 137.23 MB | 29 Nov 2014 - 17:36 |
| Harvest | 31+1 | 440.75 KB | 29 Nov 2014 - 10:15 |
| WallPaper (alias crawlpaper) | 2 | 61.74 KB | 29 Nov 2014 - 07:55 |
| StackRambler | 18 | 1.15 MB | 29 Nov 2014 - 04:12 |
| Nutch | 90+25 | 6.08 MB | 29 Nov 2014 - 01:55 |
| Unknown robot (identified by 'checker') | 30 | 0 | 28 Nov 2014 - 18:11 |
| MojeekBot | 2+8 | 18.07 KB | 28 Nov 2014 - 12:37 |
| WebCollage | 3 | 299.49 KB | 27 Nov 2014 - 22:15 |
| Web Core / Roots | 4 | 133.05 KB | 27 Nov 2014 - 10:51 |
| Checkbot | 13 | 102.96 KB | 27 Nov 2014 - 03:37 |
| larbin | 751+12 | 40.97 MB | 25 Nov 2014 - 03:39 |
| Speedy Spider | 2+2 | 17.56 KB | 24 Nov 2014 - 16:22 |
| Digger | 0+1 | 86 Bytes | 24 Nov 2014 - 02:40 |
| arks | 16 | 455.58 KB | 23 Nov 2014 - 06:34 |
| VSE | 2+2 | 48.68 KB | 22 Nov 2014 - 06:19 |
| HTTrack off-line browser | 7 | 34.57 MB | 20 Nov 2014 - 20:27 |
| Phantom | 35 | 8.14 MB | 20 Nov 2014 - 02:12 |
| psbot | 228+11 | 5.23 MB | 19 Nov 2014 - 17:14 |
| MSNBot | 8+1 | 141.18 KB | 19 Nov 2014 - 08:39 |
| Fish search | 2 | 357.28 KB | 17 Nov 2014 - 08:35 |
| LinkChecker | 3+2 | 8.87 KB | 17 Nov 2014 - 02:30 |
| MagpieRSS | 7+9 | 211.65 KB | 16 Nov 2014 - 21:40 |
| NG 1.x (Exalead) | 19 | 7.70 MB | 16 Nov 2014 - 18:31 |
| GigaBot | 2 | 33.33 KB | 12 Nov 2014 - 08:03 |
| Turn It In | 6+1 | 2.27 MB | 09 Nov 2014 - 05:09 |
| TITAN | 29 | 59.72 MB | 08 Nov 2014 - 11:05 |
| Vagabondo | 1 | 21.52 KB | 07 Nov 2014 - 12:25 |
| HTMLParser | 4 | 92.92 KB | 07 Nov 2014 - 05:29 |
| Netcraft | 1 | 8.70 KB | 07 Nov 2014 - 04:31 |
| Google AdSense | 2 | 46.51 KB | 05 Nov 2014 - 08:31 |
| Unknown robot (identified by 'sucker') | 1+1 | 26.73 KB | 02 Nov 2014 - 01:35 |
| Unknown robot (identified by '*bot') | 5 | 0 | 01 Nov 2014 - 07:10 |
| MSNBot-media | 1+1 | 1.81 KB | 01 Nov 2014 - 00:24 |