| 68 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 117561+84 | 70.21 GB | 28 Feb 2011 - 23:59 |
| Unknown robot (identified by 'bot*') | 42271+2683 | 21.53 GB | 28 Feb 2011 - 23:59 |
| MSNBot | 32686+6 | 342.78 MB | 21 Feb 2011 - 15:48 |
| Yahoo Slurp | 26935+244 | 9.14 GB | 28 Feb 2011 - 23:58 |
| Unknown robot (identified by 'crawl') | 15615+426 | 3.59 GB | 28 Feb 2011 - 23:01 |
| Yandex bot | 9676+51 | 21.78 GB | 28 Feb 2011 - 22:25 |
| Spiderman | 6557+20 | 1.08 GB | 19 Feb 2011 - 22:01 |
| Unknown robot (identified by empty user agent string) | 2804+65 | 6.15 GB | 28 Feb 2011 - 22:32 |
| Feedfetcher-Google | 2675 | 18.89 MB | 28 Feb 2011 - 23:33 |
| MSNBot-media | 1758+913 | 567.85 MB | 28 Feb 2011 - 23:27 |
| Unknown robot (identified by 'discovery') | 2610+52 | 552.19 MB | 28 Feb 2011 - 23:52 |
| ichiro | 1906+52 | 67.09 MB | 28 Feb 2011 - 20:42 |
| Unknown robot (identified by 'robot') | 1406+49 | 1.10 GB | 28 Feb 2011 - 22:32 |
| Sogou Spider | 1353+13 | 167.23 MB | 28 Feb 2011 - 23:49 |
| Exabot | 1156+68 | 20.14 MB | 28 Feb 2011 - 23:50 |
| BaiDuSpider | 789+116 | 361.59 MB | 28 Feb 2011 - 23:22 |
| Python-urllib | 631 | 17.25 MB | 26 Feb 2011 - 00:38 |
| Unknown robot (identified by hit on 'robots.txt') | 0+624 | 18.86 KB | 28 Feb 2011 - 21:13 |
| Unknown robot (identified by 'spider') | 566+53 | 31.91 MB | 28 Feb 2011 - 22:27 |
| WGet tools | 349+3 | 73.86 MB | 28 Feb 2011 - 09:07 |
| Nutch | 281+17 | 9.86 MB | 28 Feb 2011 - 00:21 |
| MJ12bot | 243+34 | 10.40 MB | 28 Feb 2011 - 14:58 |
| Unknown robot (identified by '*bot') | 75+165 | 1.22 MB | 28 Feb 2011 - 23:11 |
| Alexa (IA Archiver) | 139+69 | 51.21 MB | 28 Feb 2011 - 08:48 |
| Speedy Spider | 88+84 | 18.96 MB | 28 Feb 2011 - 21:46 |
| yacy | 159+8 | 101.70 MB | 28 Feb 2011 - 16:38 |
| Fish search | 153 | 8.97 MB | 21 Feb 2011 - 18:22 |
| Java (Often spam bot) | 116+12 | 114.56 MB | 28 Feb 2011 - 18:36 |
| CFNetwork | 104 | 1.64 GB | 28 Feb 2011 - 23:07 |
| bender focused_crawler | 69+20 | 215.29 MB | 28 Feb 2011 - 23:43 |
| DoCoMo | 51+35 | 815.88 KB | 28 Feb 2011 - 22:59 |
| Jakarta commons-httpclient | 82 | 46.59 MB | 28 Feb 2011 - 10:09 |
| Motor | 69 | 50.10 MB | 20 Feb 2011 - 16:28 |
| Harvest | 60 | 12.42 MB | 28 Feb 2011 - 11:06 |
| FaceBook bot | 55+1 | 3.01 MB | 28 Feb 2011 - 12:13 |
| Ask | 39+17 | 2.61 MB | 28 Feb 2011 - 21:26 |
| Perl tool | 49 | 590.40 KB | 24 Feb 2011 - 12:55 |
| Findlinks | 36+6 | 699.55 KB | 28 Feb 2011 - 11:54 |
| EasyDL | 37 | 794.82 KB | 21 Feb 2011 - 10:34 |
| larbin | 33+4 | 310.70 KB | 15 Feb 2011 - 22:29 |
| GigaBot | 5+26 | 11.37 MB | 19 Feb 2011 - 21:19 |
| The web archive (IA Archiver) | 0+30 | 930 Bytes | 27 Feb 2011 - 05:45 |
| legs | 12+11 | 272.91 KB | 13 Feb 2011 - 18:44 |
| UCSD Crawl | 22 | 626.01 KB | 09 Feb 2011 - 15:56 |
| NG 2.x (Exalead) | 0+18 | 558 Bytes | 27 Feb 2011 - 19:12 |
| NutchCVS | 17+1 | 691.67 KB | 28 Feb 2011 - 11:14 |
| WordPress | 14 | 253.93 KB | 28 Feb 2011 - 19:42 |
| Heritrix | 12+1 | 38.91 MB | 20 Feb 2011 - 19:00 |
| Web Core / Roots | 11 | 160.37 KB | 28 Feb 2011 - 10:07 |
| Powermarks | 10 | 144.12 KB | 24 Feb 2011 - 20:19 |
| Feedburner | 9 | 0 | 15 Feb 2011 - 15:18 |
| MSIECrawler | 2+7 | 50.88 KB | 28 Feb 2011 - 07:05 |
| WebCollage | 6 | 39.70 KB | 28 Feb 2011 - 19:28 |
| Unknown robot (identified by 'scanner') | 3+3 | 31.23 KB | 26 Feb 2011 - 15:00 |
| BSpider | 4+2 | 11.46 MB | 21 Feb 2011 - 08:59 |
| Google AdSense | 6 | 8.46 MB | 26 Feb 2011 - 22:44 |
| Custo | 2+2 | 5.60 MB | 24 Feb 2011 - 16:11 |
| HTTrack off-line browser | 3+1 | 5.95 MB | 01 Feb 2011 - 10:48 |
| Checkbot | 3 | 0 | 24 Feb 2011 - 03:44 |
| Voyager | 3 | 50.06 KB | 08 Feb 2011 - 20:10 |
| OutfoxBot/YodaoBot | 1+1 | 258.88 KB | 11 Feb 2011 - 23:34 |
| FavIconizer | 2 | 14.14 KB | 18 Feb 2011 - 13:21 |
| BBot | 2 | 4.20 MB | 05 Feb 2011 - 16:06 |
| Unknown robot (identified by 'checker') | 2 | 4.07 MB | 04 Feb 2011 - 02:17 |
| Y!J Yahoo Japan | 2 | 70.95 KB | 16 Feb 2011 - 01:33 |
| Tarantula | 2 | 12.34 KB | 03 Feb 2011 - 18:02 |
| QihooBot | 1 | 8.22 KB | 12 Feb 2011 - 18:38 |
| NG 1.x (Exalead) | 1 | 16.69 KB | 08 Feb 2011 - 20:10 |