| 75 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 72599+979 | 170.44 GB | 31 Dec 2008 - 23:59 |
| Yahoo Slurp | 53538+997 | 55.28 GB | 31 Dec 2008 - 23:59 |
| Googlebot | 52851+106 | 107.67 GB | 31 Dec 2008 - 23:57 |
| MSNBot | 13061+806 | 12.37 GB | 31 Dec 2008 - 23:56 |
| Exabot | 925+57 | 613.02 MB | 31 Dec 2008 - 23:39 |
| NG 2.x (Exalead) | 0+37 | 4.73 KB | 31 Dec 2008 - 23:19 |
| Unknown robot (identified by hit on 'robots.txt') | 0+600 | 38.76 KB | 31 Dec 2008 - 23:17 |
| Unknown robot (identified by empty user agent string) | 868+423 | 689.68 MB | 31 Dec 2008 - 23:16 |
| Sogou Spider | 678 | 10.87 MB | 31 Dec 2008 - 23:03 |
| Ask | 3726+140 | 4.93 GB | 31 Dec 2008 - 22:51 |
| HTTrack off-line browser | 4970+3 | 15.28 GB | 31 Dec 2008 - 22:16 |
| Voila | 693+76 | 348.56 MB | 31 Dec 2008 - 21:58 |
| Unknown robot (identified by 'robot') | 497+362 | 161.11 MB | 31 Dec 2008 - 21:34 |
| BSpider | 483+8 | 60.95 MB | 31 Dec 2008 - 20:38 |
| MSNBot-media | 3460+206 | 1.48 GB | 31 Dec 2008 - 20:12 |
| Java (Often spam bot) | 574+36 | 149.16 MB | 31 Dec 2008 - 19:46 |
| Nutch | 6671+126 | 1.43 GB | 31 Dec 2008 - 19:25 |
| BaiDuSpider | 2139+21 | 92.87 MB | 31 Dec 2008 - 18:45 |
| GigaBot | 560+79 | 235.00 MB | 31 Dec 2008 - 18:26 |
| Alexa (IA Archiver) | 526+28 | 30.19 MB | 31 Dec 2008 - 17:07 |
| Steeler | 18+1 | 18.43 MB | 31 Dec 2008 - 15:53 |
| Feedfetcher-Google | 1 | 8.94 MB | 31 Dec 2008 - 15:39 |
| WGet tools | 17186+2 | 208.49 MB | 31 Dec 2008 - 15:36 |
| UCSD Crawl | 6+6 | 48.27 MB | 31 Dec 2008 - 14:19 |
| twiceler | 199+37 | 4.89 MB | 31 Dec 2008 - 13:21 |
| Scooter | 4 | 26.60 KB | 31 Dec 2008 - 09:44 |
| Unknown robot (identified by 'bot*') | 183+70 | 135.50 MB | 31 Dec 2008 - 08:50 |
| Unknown robot (identified by 'discovery') | 2447+2 | 30.64 MB | 31 Dec 2008 - 05:01 |
| Unknown robot (identified by 'spider') | 103+83 | 25.03 MB | 31 Dec 2008 - 01:44 |
| Perl tool | 7847+1 | 51.92 GB | 30 Dec 2008 - 23:24 |
| The web archive (IA Archiver) | 0+138 | 17.65 KB | 30 Dec 2008 - 19:44 |
| Jakarta commons-httpclient | 79+8 | 59.95 MB | 30 Dec 2008 - 18:41 |
| INFOMINE VLCrawler | 538 | 4.56 MB | 30 Dec 2008 - 15:18 |
| Custo | 10+4 | 28.73 MB | 30 Dec 2008 - 06:06 |
| CFNetwork | 63 | 520.08 MB | 30 Dec 2008 - 02:12 |
| Speedy Spider | 70+49 | 39.12 MB | 29 Dec 2008 - 14:34 |
| BBot | 38 | 51.36 MB | 29 Dec 2008 - 12:12 |
| Girafabot | 0+2 | 262 Bytes | 29 Dec 2008 - 09:09 |
| Harvest | 547 | 197.00 MB | 28 Dec 2008 - 14:36 |
| yacy | 26+1 | 13.73 MB | 28 Dec 2008 - 04:47 |
| BecomeBot | 1+2 | 401 Bytes | 27 Dec 2008 - 08:54 |
| Checkbot | 8 | 0 | 26 Dec 2008 - 16:44 |
| Gaisbot | 6+7 | 32.34 KB | 26 Dec 2008 - 04:58 |
| Python-urllib | 65+2 | 225.35 MB | 26 Dec 2008 - 00:41 |
| OutfoxBot/YodaoBot | 4+3 | 38.31 KB | 25 Dec 2008 - 15:25 |
| boitho.com-dc | 0+1 | 131 Bytes | 25 Dec 2008 - 10:24 |
| Yanga WorldSearch Bot | 3+3 | 810 Bytes | 25 Dec 2008 - 09:37 |
| MSIECrawler | 8+3 | 2.42 MB | 25 Dec 2008 - 07:44 |
| DoCoMo | 1+1 | 6.74 KB | 24 Dec 2008 - 18:42 |
| FaceBook bot | 4 | 9.43 MB | 24 Dec 2008 - 12:25 |
| MJ12bot | 13+4 | 138.24 KB | 23 Dec 2008 - 21:09 |
| Fish search | 7 | 64.07 KB | 23 Dec 2008 - 20:14 |
| Voyager | 455+3 | 5.71 MB | 23 Dec 2008 - 15:00 |
| Grub.org | 3+3 | 33.30 KB | 23 Dec 2008 - 14:34 |
| arks | 0+2 | 262 Bytes | 23 Dec 2008 - 12:40 |
| larbin | 10+10 | 74.25 KB | 23 Dec 2008 - 06:27 |
| lwp-trivial | 1 | 8.20 MB | 22 Dec 2008 - 23:38 |
| Ocelli | 129+3 | 12.63 MB | 21 Dec 2008 - 08:07 |
| Web Core / Roots | 1+1 | 270 Bytes | 21 Dec 2008 - 01:44 |
| EasyDL | 3 | 245.77 KB | 20 Dec 2008 - 16:49 |
| Cursor | 2 | 19.67 KB | 19 Dec 2008 - 19:06 |
| WebCollage | 1 | 15.77 KB | 17 Dec 2008 - 05:59 |
| YahooSeeker Yahoo! Blog crawler | 1+1 | 47.43 KB | 17 Dec 2008 - 01:51 |
| archive.org bot | 1+1 | 2.04 MB | 17 Dec 2008 - 01:07 |
| Powermarks | 3 | 1.24 MB | 14 Dec 2008 - 17:13 |
| psbot | 9+7 | 602.43 KB | 11 Dec 2008 - 16:08 |
| Netcraft | 4 | 824.22 KB | 11 Dec 2008 - 11:09 |
| Yandex bot | 4+1 | 405.37 KB | 09 Dec 2008 - 20:40 |
| Unknown robot (identified by 'hunter') | 3 | 37.17 KB | 06 Dec 2008 - 11:16 |
| QihooBot | 2 | 626.82 KB | 06 Dec 2008 - 09:33 |
| Turn It In | 657+3 | 1.11 GB | 05 Dec 2008 - 09:13 |
| T-H-U-N-D-E-R-S-T-O-N-E | 1 | 7.46 KB | 05 Dec 2008 - 01:40 |
| Heritrix | 2+2 | 540 Bytes | 04 Dec 2008 - 00:03 |
| Pioneer | 1 | 7.95 KB | 03 Dec 2008 - 22:41 |
| Others | 0 | 0 | |