| 74 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 59774+1160 | 80.73 GB | 31 Aug 2008 - 11:35 |
| Yahoo Slurp | 58564+477 | 80.08 GB | 31 Aug 2008 - 23:59 |
| Googlebot | 38296+82 | 29.00 GB | 31 Aug 2008 - 23:59 |
| MSNBot | 35086+1221 | 4.64 GB | 31 Aug 2008 - 23:58 |
| MSNBot-media | 8972+276 | 2.63 GB | 31 Aug 2008 - 16:43 |
| BaiDuSpider | 6105+19 | 560.41 MB | 31 Aug 2008 - 19:23 |
| GigaBot | 3502+159 | 1.91 GB | 29 Aug 2008 - 16:26 |
| Gaisbot | 3436+7 | 36.04 MB | 31 Aug 2008 - 22:33 |
| Unknown robot (identified by empty user agent string) | 2517+333 | 435.70 MB | 31 Aug 2008 - 22:34 |
| Sogou Spider | 2803+2 | 104.19 MB | 31 Aug 2008 - 23:36 |
| ichiro | 2777+1 | 487.67 MB | 27 Aug 2008 - 05:13 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1946 | 243.45 KB | 31 Aug 2008 - 23:52 |
| DoCoMo | 1889+1 | 22.56 MB | 24 Aug 2008 - 21:40 |
| Nutch | 1772+71 | 168.63 MB | 31 Aug 2008 - 21:52 |
| Unknown robot (identified by 'discovery') | 1265+1 | 20.15 MB | 31 Aug 2008 - 06:59 |
| BecomeBot | 1216+7 | 16.16 MB | 27 Aug 2008 - 08:36 |
| Turn It In | 761+10 | 1.42 GB | 29 Aug 2008 - 01:47 |
| Ask | 682+82 | 291.04 MB | 31 Aug 2008 - 23:43 |
| MJ12bot | 700+16 | 498.95 MB | 21 Aug 2008 - 04:36 |
| Unknown robot (identified by 'bot*') | 597+112 | 138.51 MB | 30 Aug 2008 - 22:24 |
| Unknown robot (identified by 'robot') | 460+98 | 119.13 MB | 31 Aug 2008 - 23:44 |
| Speedy Spider | 367+79 | 2.60 GB | 31 Aug 2008 - 15:59 |
| Alexa (IA Archiver) | 376+45 | 132.33 MB | 31 Aug 2008 - 21:59 |
| Voila | 342+53 | 199.51 MB | 31 Aug 2008 - 08:10 |
| twiceler | 312+33 | 89.57 MB | 31 Aug 2008 - 03:23 |
| Harvest | 292 | 89.58 MB | 31 Aug 2008 - 13:27 |
| Perl tool | 180+2 | 37.02 MB | 31 Aug 2008 - 05:42 |
| OutfoxBot/YodaoBot | 135+37 | 4.12 MB | 31 Aug 2008 - 05:01 |
| Unknown robot (identified by 'spider') | 131+7 | 10.59 MB | 29 Aug 2008 - 11:26 |
| WGet tools | 88+1 | 53.01 MB | 31 Aug 2008 - 21:39 |
| Java (Often spam bot) | 52+37 | 61.65 MB | 31 Aug 2008 - 23:47 |
| CFNetwork | 69 | 528.36 MB | 31 Aug 2008 - 06:54 |
| Ocelli | 62+2 | 6.40 MB | 22 Aug 2008 - 05:55 |
| psbot | 39+13 | 590.37 MB | 31 Aug 2008 - 13:56 |
| Exabot | 46+2 | 2.75 MB | 29 Aug 2008 - 18:22 |
| BBot | 47 | 133.68 MB | 30 Aug 2008 - 20:43 |
| Dumbot | 44+1 | 676.34 KB | 25 Aug 2008 - 11:12 |
| The web archive (IA Archiver) | 0+40 | 5.12 KB | 31 Aug 2008 - 17:39 |
| WordPress | 39 | 326.22 MB | 29 Aug 2008 - 21:47 |
| Custo | 32 | 159.90 MB | 27 Aug 2008 - 02:58 |
| EasyDL | 26 | 824.88 KB | 30 Aug 2008 - 22:51 |
| Jakarta commons-httpclient | 11+9 | 9.27 MB | 31 Aug 2008 - 16:28 |
| UCSD Crawl | 13+7 | 24.43 MB | 26 Aug 2008 - 18:54 |
| HTMLParser | 17 | 759.00 KB | 29 Aug 2008 - 13:45 |
| BSpider | 5+10 | 1.22 MB | 30 Aug 2008 - 06:31 |
| yacy | 13 | 729.77 KB | 30 Aug 2008 - 07:24 |
| boitho.com-dc | 6+5 | 1.23 MB | 29 Aug 2008 - 21:24 |
| larbin | 6+5 | 44.47 KB | 28 Aug 2008 - 10:54 |
| MSIECrawler | 3+8 | 34.69 KB | 29 Aug 2008 - 17:25 |
| Hylanda | 10 | 115.01 KB | 16 Aug 2008 - 20:18 |
| Checkbot | 9 | 0 | 29 Aug 2008 - 04:23 |
| Holmes | 5+3 | 46.28 KB | 05 Aug 2008 - 05:17 |
| HTTrack off-line browser | 6+2 | 5.07 MB | 28 Aug 2008 - 08:29 |
| Python-urllib | 8 | 6.97 MB | 31 Aug 2008 - 20:41 |
| The World Wide Web Worm | 7 | 0 | 29 Aug 2008 - 14:45 |
| Combine System | 5+2 | 2.22 MB | 27 Aug 2008 - 14:33 |
| Yandex bot | 6 | 17.24 KB | 27 Aug 2008 - 18:32 |
| NG 2.x (Exalead) | 0+6 | 786 Bytes | 24 Aug 2008 - 06:38 |
| Unknown robot (identified by '*bot') | 4+1 | 30.55 KB | 10 Aug 2008 - 09:16 |
| Biglotron | 2+2 | 13.48 KB | 21 Aug 2008 - 18:45 |
| Web Core / Roots | 3+1 | 608.21 KB | 28 Aug 2008 - 19:38 |
| Heritrix | 2+2 | 2.04 MB | 22 Aug 2008 - 13:08 |
| Internet Shinchakubin | 3 | 35.59 KB | 07 Aug 2008 - 10:12 |
| arks | 2+1 | 131 Bytes | 30 Aug 2008 - 07:12 |
| Motor | 2 | 18.76 KB | 29 Aug 2008 - 13:55 |
| Pioneer | 2 | 19.04 KB | 19 Aug 2008 - 17:45 |
| Fish search | 2 | 22.72 KB | 10 Aug 2008 - 17:41 |
| NutchCVS | 1+1 | 270 Bytes | 06 Aug 2008 - 18:47 |
| Unknown robot (identified by 'hunter') | 2 | 19.80 KB | 12 Aug 2008 - 05:08 |
| archive.org bot | 1+1 | 705.44 KB | 21 Aug 2008 - 19:33 |
| FaceBook bot | 1 | 2.58 MB | 24 Aug 2008 - 23:00 |
| Robozilla | 1 | 139 Bytes | 31 Aug 2008 - 20:06 |
| lwp-request | 1 | 0 | 31 Aug 2008 - 11:48 |
| Powermarks | 1 | 55.09 KB | 28 Aug 2008 - 17:13 |