| 70 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 119039+125 | 52.69 GB | 30 Sep 2012 - 23:59 |
| Unknown robot (identified by 'bot*') | 92927+641 | 125.89 GB | 30 Sep 2012 - 23:59 |
| Yandex bot | 34636+82 | 33.66 GB | 30 Sep 2012 - 23:59 |
| BaiDuSpider | 24434+189 | 6.64 GB | 30 Sep 2012 - 23:59 |
| Unknown robot (identified by 'spider') | 20153+139 | 20.35 GB | 30 Sep 2012 - 23:59 |
| Unknown robot (identified by 'crawl') | 19337+738 | 12.48 GB | 30 Sep 2012 - 23:18 |
| Unknown robot (identified by 'discovery') | 18361+18 | 28.72 GB | 28 Sep 2012 - 16:44 |
| Sogou Spider | 13826+23 | 1.01 GB | 30 Sep 2012 - 23:54 |
| Exabot | 11920+57 | 9.32 GB | 30 Sep 2012 - 23:58 |
| Feedfetcher-Google | 3691 | 26.77 MB | 30 Sep 2012 - 23:48 |
| Yahoo Slurp | 2629+28 | 126.78 MB | 30 Sep 2012 - 20:29 |
| psbot | 1441+45 | 29.40 MB | 28 Sep 2012 - 16:24 |
| Unknown robot (identified by empty user agent string) | 1260+163 | 3.51 GB | 30 Sep 2012 - 22:08 |
| Java (Often spam bot) | 1044+10 | 125.05 MB | 30 Sep 2012 - 22:48 |
| Unknown robot (identified by 'robot') | 842+20 | 1.19 GB | 30 Sep 2012 - 08:54 |
| BSpider | 609+57 | 17.20 MB | 30 Sep 2012 - 23:51 |
| Unknown robot (identified by hit on 'robots.txt') | 0+534 | 16.17 KB | 30 Sep 2012 - 23:18 |
| FaceBook bot | 499 | 9.67 MB | 30 Sep 2012 - 14:51 |
| MSNBot | 457+31 | 114.40 MB | 30 Sep 2012 - 21:07 |
| MJ12bot | 298+109 | 20.71 MB | 30 Sep 2012 - 16:57 |
| CFNetwork | 353 | 373.13 MB | 30 Sep 2012 - 22:30 |
| Unknown robot (identified by '*bot') | 100+248 | 8.62 MB | 30 Sep 2012 - 19:52 |
| Mail.ru bot | 334+12 | 940.89 MB | 28 Sep 2012 - 19:01 |
| Alexa (IA Archiver) | 191+151 | 71.06 MB | 30 Sep 2012 - 19:31 |
| WordPress | 305 | 91.21 MB | 30 Sep 2012 - 18:06 |
| Nutch | 256+46 | 46.65 MB | 30 Sep 2012 - 23:08 |
| OutfoxBot/YodaoBot | 150+132 | 1.03 MB | 30 Sep 2012 - 20:18 |
| legs | 195+62 | 121.75 MB | 30 Sep 2012 - 07:08 |
| NG 1.x (Exalead) | 201 | 1.41 MB | 30 Sep 2012 - 13:42 |
| yacy | 151+3 | 128.15 MB | 30 Sep 2012 - 02:27 |
| bender focused_crawler | 122+6 | 214.49 MB | 20 Sep 2012 - 04:40 |
| Jakarta commons-httpclient | 110 | 36.24 MB | 30 Sep 2012 - 13:45 |
| MSNBot-media | 38+29 | 1.08 MB | 30 Sep 2012 - 10:57 |
| WebFilter | 61 | 639.66 KB | 30 Sep 2012 - 07:00 |
| DoCoMo | 27+27 | 454.62 KB | 30 Sep 2012 - 17:40 |
| Y!J Yahoo Japan | 26+26 | 19.96 MB | 23 Sep 2012 - 05:29 |
| WGet tools | 45+4 | 155.07 MB | 30 Sep 2012 - 13:14 |
| SeznamBot | 34+12 | 11.78 MB | 27 Sep 2012 - 23:08 |
| archive.org bot | 33+6 | 73.02 MB | 16 Sep 2012 - 14:32 |
| Python-urllib | 3+26 | 11.25 MB | 29 Sep 2012 - 17:09 |
| Motor | 25 | 15.26 MB | 22 Sep 2012 - 02:06 |
| Harvest | 25 | 673.85 KB | 30 Sep 2012 - 08:52 |
| Web Core / Roots | 23 | 611.85 KB | 25 Sep 2012 - 18:13 |
| Perl tool | 21+1 | 23.73 MB | 30 Sep 2012 - 23:49 |
| ichiro | 8+8 | 120.66 KB | 18 Sep 2012 - 16:09 |
| Heritrix | 10+5 | 233.32 KB | 10 Sep 2012 - 03:00 |
| Findlinks | 8+3 | 181.44 KB | 28 Sep 2012 - 14:37 |
| HTMLParser | 11 | 453.30 KB | 13 Sep 2012 - 00:32 |
| MagpieRSS | 0+9 | 279 Bytes | 25 Sep 2012 - 09:46 |
| larbin | 5+3 | 11.33 MB | 30 Sep 2012 - 01:24 |
| Netcraft | 5 | 27.98 KB | 08 Sep 2012 - 23:52 |
| Checkbot | 4 | 0 | 27 Sep 2012 - 04:04 |
| Fish search | 3 | 3.63 MB | 02 Sep 2012 - 16:24 |
| WebCollage | 2 | 13.45 KB | 11 Sep 2012 - 05:42 |
| HTTrack off-line browser | 2 | 6.78 MB | 11 Sep 2012 - 20:46 |
| FavIconizer | 2 | 13.99 KB | 25 Sep 2012 - 08:26 |
| Unknown robot (identified by 'checker') | 2 | 0 | 25 Sep 2012 - 15:02 |
| ASpider (Associative Spider) | 1 | 21.45 KB | 09 Sep 2012 - 02:55 |
| W3C Validator | 1 | 7.20 MB | 12 Sep 2012 - 07:22 |
| Grub.org | 1 | 19.93 KB | 03 Sep 2012 - 06:10 |
| StackRambler | 1 | 509.72 KB | 03 Sep 2012 - 01:43 |
| Webdup | 1 | 6.99 KB | 10 Sep 2012 - 22:17 |
| Fast-Webcrawler | 1 | 6.99 KB | 02 Sep 2012 - 18:19 |
| Phantom | 1 | 5.67 MB | 25 Sep 2012 - 22:06 |
| UCSD Crawl | 1 | 110.50 KB | 22 Sep 2012 - 17:00 |
| Mirago | 1 | 6.99 KB | 24 Sep 2012 - 20:18 |
| Alkaline | 1 | 6.99 KB | 09 Sep 2012 - 12:22 |
| Voila | 0+1 | 31 Bytes | 10 Sep 2012 - 03:09 |
| ExactSeek Crawler | 1 | 6.99 KB | 29 Sep 2012 - 18:19 |
| MSIECrawler | 1 | 6.99 KB | 01 Sep 2012 - 10:38 |