| 62 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 76536+116 | 17.43 GB | 31 Jul 2010 - 23:54 |
| Unknown robot (identified by 'crawl') | 27335+1193 | 23.54 GB | 31 Jul 2010 - 22:38 |
| Yahoo Slurp | 28084+313 | 6.48 GB | 31 Jul 2010 - 23:59 |
| MSNBot | 22606+1943 | 4.35 GB | 31 Jul 2010 - 23:55 |
| MSNBot-media | 8767+1366 | 183.04 MB | 31 Jul 2010 - 19:17 |
| archive.org bot | 4455+17 | 91.91 MB | 31 Jul 2010 - 23:57 |
| MJ12bot | 4140+43 | 63.66 MB | 29 Jul 2010 - 22:42 |
| twiceler | 2844+557 | 205.73 MB | 30 Jul 2010 - 16:05 |
| Yandex bot | 2418+39 | 847.31 MB | 31 Jul 2010 - 22:16 |
| Unknown robot (identified by empty user agent string) | 1156+366 | 694.84 MB | 31 Jul 2010 - 22:53 |
| Alexa (IA Archiver) | 1415+81 | 203.93 MB | 31 Jul 2010 - 23:31 |
| Feedfetcher-Google | 1470 | 10.71 MB | 31 Jul 2010 - 23:34 |
| Heritrix | 1236+3 | 604.13 MB | 30 Jul 2010 - 22:16 |
| Ask | 980+248 | 516.51 MB | 31 Jul 2010 - 20:52 |
| Exabot | 1153+67 | 603.56 MB | 31 Jul 2010 - 23:36 |
| BaiDuSpider | 933+239 | 281.15 MB | 31 Jul 2010 - 22:49 |
| Unknown robot (identified by 'bot*') | 716+432 | 323.91 MB | 31 Jul 2010 - 23:54 |
| Nutch | 542+75 | 18.89 MB | 31 Jul 2010 - 12:17 |
| Bloglines | 346 | 2.48 MB | 31 Jul 2010 - 22:09 |
| Unknown robot (identified by hit on 'robots.txt') | 0+345 | 10.44 KB | 31 Jul 2010 - 22:32 |
| Unknown robot (identified by 'spider') | 168+57 | 3.99 MB | 31 Jul 2010 - 13:45 |
| Unknown robot (identified by 'discovery') | 31+69 | 197.90 KB | 30 Jul 2010 - 14:52 |
| Unknown robot (identified by 'robot') | 67+33 | 17.11 MB | 31 Jul 2010 - 14:53 |
| Harvest | 87 | 21.91 MB | 30 Jul 2010 - 16:12 |
| yacy | 79+4 | 38.29 MB | 28 Jul 2010 - 10:39 |
| Java (Often spam bot) | 53+22 | 12.54 MB | 31 Jul 2010 - 18:32 |
| CFNetwork | 69 | 760.91 MB | 29 Jul 2010 - 07:20 |
| Sogou Spider | 35+30 | 364.89 KB | 30 Jul 2010 - 20:03 |
| EasyDL | 34 | 973.11 KB | 29 Jul 2010 - 03:42 |
| legs | 9+21 | 101.21 KB | 06 Jul 2010 - 04:29 |
| WGet tools | 22 | 64.20 MB | 31 Jul 2010 - 10:41 |
| NG 2.x (Exalead) | 0+20 | 620 Bytes | 29 Jul 2010 - 13:37 |
| Custo | 17 | 1.79 MB | 19 Jul 2010 - 01:12 |
| Perl tool | 17 | 127.70 KB | 29 Jul 2010 - 03:00 |
| FaceBook bot | 13+1 | 327.64 KB | 31 Jul 2010 - 06:11 |
| Speedy Spider | 7+7 | 133.28 KB | 21 Jul 2010 - 07:34 |
| MSIECrawler | 9+5 | 141.70 KB | 28 Jul 2010 - 08:02 |
| Python-urllib | 12 | 218.57 KB | 25 Jul 2010 - 00:56 |
| WordPress | 11 | 32.72 KB | 06 Jul 2010 - 07:24 |
| BBot | 11 | 15.94 MB | 16 Jul 2010 - 12:59 |
| Jakarta commons-httpclient | 9+1 | 6.59 MB | 30 Jul 2010 - 17:13 |
| Mail.ru bot | 6+3 | 713.39 KB | 26 Jul 2010 - 17:15 |
| larbin | 5+4 | 83.53 KB | 11 Jul 2010 - 15:01 |
| Gaisbot | 3+5 | 40.01 KB | 30 Jul 2010 - 03:53 |
| Google AdSense | 6 | 1.03 MB | 26 Jul 2010 - 01:57 |
| The web archive (IA Archiver) | 0+5 | 155 Bytes | 29 Jul 2010 - 03:33 |
| Netcraft | 5 | 28.28 KB | 10 Jul 2010 - 05:45 |
| GigaBot | 2+2 | 14.20 KB | 26 Jul 2010 - 05:53 |
| FavIconizer | 4 | 28.28 KB | 31 Jul 2010 - 07:13 |
| DoCoMo | 1+2 | 7.13 KB | 26 Jul 2010 - 22:23 |
| Unknown robot (identified by 'scanner') | 1+1 | 20.06 MB | 24 Jul 2010 - 07:56 |
| OutfoxBot/YodaoBot | 1+1 | 258.88 KB | 05 Jul 2010 - 15:02 |
| WebCollage | 2 | 122.95 KB | 05 Jul 2010 - 04:38 |
| W3C Link Checker | 0+2 | 62 Bytes | 14 Jul 2010 - 06:15 |
| Findlinks | 1+1 | 7.10 KB | 08 Jul 2010 - 07:01 |
| Feedburner | 2 | 0 | 18 Jul 2010 - 18:30 |
| ichiro | 0+2 | 62 Bytes | 27 Jul 2010 - 16:51 |
| Digger | 0+1 | 31 Bytes | 01 Jul 2010 - 20:47 |
| UCSD Crawl | 1 | 868.48 KB | 26 Jul 2010 - 10:12 |
| W3C Validator | 1 | 7.07 KB | 27 Jul 2010 - 06:12 |
| Spiderman | 0+1 | 31 Bytes | 08 Jul 2010 - 12:16 |
| HTTrack off-line browser | 0+1 | 31 Bytes | 22 Jul 2010 - 19:22 |