| 83 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 250765+1303 | 137.72 GB | 30 Sep 2005 - 23:41 |
| Googlebot | 83948+317 | 39.46 GB | 30 Sep 2005 - 23:59 |
| Yahoo Slurp | 10096+1121 | 7.58 GB | 30 Sep 2005 - 23:57 |
| Ask | 9912+83 | 122.60 MB | 30 Sep 2005 - 21:30 |
| MSNBot | 6341+234 | 8.27 GB | 30 Sep 2005 - 23:19 |
| INFOMINE VLCrawler | 2764+3 | 658.04 MB | 21 Sep 2005 - 08:00 |
| BecomeBot | 2160+82 | 22.34 MB | 30 Sep 2005 - 21:56 |
| Nutch | 2127+9 | 18.39 MB | 18 Sep 2005 - 23:51 |
| BaiDuSpider | 1699+6 | 22.30 MB | 26 Sep 2005 - 18:03 |
| UdmSearch | 1587 | 5.39 MB | 08 Sep 2005 - 14:27 |
| Jakarta commons-httpclient | 1307 | 105.01 MB | 30 Sep 2005 - 23:59 |
| GigaBot | 506+68 | 14.64 MB | 25 Sep 2005 - 12:07 |
| Harvest | 470 | 144.45 MB | 30 Sep 2005 - 10:29 |
| Unknown robot (identified by empty user agent string) | 298+111 | 118.33 MB | 30 Sep 2005 - 18:43 |
| Turn It In | 394+3 | 910.49 MB | 29 Sep 2005 - 18:16 |
| Grub.org | 381 | 3.23 MB | 30 Sep 2005 - 21:23 |
| ConveraCrawler | 353+2 | 88.71 MB | 18 Sep 2005 - 01:46 |
| Java (Often spam bot) | 349+6 | 28.02 MB | 30 Sep 2005 - 22:28 |
| MJ12bot | 314+8 | 5.62 MB | 30 Sep 2005 - 07:38 |
| aipbot | 271+10 | 1.60 MB | 30 Sep 2005 - 22:19 |
| NG 2.x (Exalead) | 230+3 | 2.46 MB | 23 Sep 2005 - 00:31 |
| nicebot | 203 | 5.47 MB | 30 Sep 2005 - 21:27 |
| Alexa (IA Archiver) | 76+105 | 11.69 MB | 30 Sep 2005 - 20:45 |
| Perl tool | 150 | 50.60 MB | 30 Sep 2005 - 22:33 |
| IBM Almaden Research Center WebFountain™ | 102+29 | 259.73 MB | 26 Sep 2005 - 14:36 |
| Unknown robot (identified by 'bot*') | 79+22 | 15.54 MB | 30 Sep 2005 - 10:12 |
| psbot | 55+34 | 422.96 KB | 30 Sep 2005 - 16:07 |
| Unknown robot (identified by 'robot') | 77+4 | 4.30 MB | 30 Sep 2005 - 17:48 |
| NutchCVS | 34+22 | 615.96 KB | 23 Sep 2005 - 13:01 |
| Google AdSense | 56 | 1.80 MB | 26 Sep 2005 - 01:57 |
| The web archive | 53+2 | 3.33 MB | 30 Sep 2005 - 12:00 |
| WGet tools | 42 | 161.61 MB | 28 Sep 2005 - 01:07 |
| Voila | 13+17 | 2.42 MB | 19 Sep 2005 - 21:23 |
| Combine System | 17+12 | 138.16 KB | 28 Sep 2005 - 04:27 |
| Unknown robot (identified by hit on 'robots.txt') | 0+29 | 1.97 KB | 29 Sep 2005 - 15:34 |
| Spiderman | 26 | 35.23 KB | 30 Sep 2005 - 05:09 |
| Custo | 25 | 37.22 MB | 30 Sep 2005 - 17:21 |
| sohu-search | 16+8 | 1.48 MB | 27 Sep 2005 - 13:28 |
| Cfetch | 18+4 | 115.00 KB | 22 Sep 2005 - 12:49 |
| Unknown robot (identified by 'discovery') | 20 | 0 | 30 Sep 2005 - 08:55 |
| archive.org bot | 9+9 | 10.68 MB | 30 Sep 2005 - 05:39 |
| Walhello appie | 7+10 | 70.32 KB | 29 Sep 2005 - 06:44 |
| Girafabot | 12+4 | 1.62 MB | 13 Sep 2005 - 13:30 |
| CFNetwork | 15 | 79.95 MB | 21 Sep 2005 - 13:14 |
| Unknown robot (identified by 'spider') | 7+7 | 1.31 KB | 28 Sep 2005 - 17:44 |
| KnowItAll | 7+6 | 65.67 KB | 30 Sep 2005 - 13:52 |
| Findlinks | 3+9 | 5.14 KB | 29 Sep 2005 - 03:41 |
| Argus | 8+4 | 620.73 KB | 23 Sep 2005 - 23:52 |
| ichiro | 10+1 | 44.64 KB | 12 Sep 2005 - 04:09 |
| Unknown robot (identified by 'checker') | 9 | 301.20 KB | 30 Sep 2005 - 07:21 |
| Scooter | 0+9 | 648 Bytes | 30 Sep 2005 - 18:18 |
| Yahoo-MMCrawler | 5+4 | 32.12 KB | 28 Sep 2005 - 20:32 |
| Heritrix | 4+4 | 5.49 MB | 27 Sep 2005 - 00:32 |
| SBIder | 4+4 | 24.30 KB | 20 Sep 2005 - 19:35 |
| MSIECrawler | 2+5 | 519.23 KB | 17 Sep 2005 - 11:28 |
| updated | 3+3 | 633 Bytes | 05 Sep 2005 - 18:30 |
| Cursor | 5 | 11.93 MB | 13 Sep 2005 - 12:20 |
| HTTrack off-line browser | 4 | 1.41 MB | 13 Sep 2005 - 06:19 |
| InfoSeek Robot 1.0 | 2+2 | 9.85 KB | 25 Sep 2005 - 17:27 |
| InternetArchive | 2+2 | 7.43 KB | 27 Sep 2005 - 20:17 |
| Calif | 3 | 26.22 KB | 15 Sep 2005 - 12:13 |
| Kevin | 3 | 34.49 KB | 28 Sep 2005 - 04:45 |
| Seekbot | 2+1 | 9.28 KB | 26 Sep 2005 - 18:23 |
| twiceler | 0+3 | 216 Bytes | 26 Sep 2005 - 22:24 |
| IlTrovatore-Setaccio | 1+1 | 211 Bytes | 11 Sep 2005 - 13:52 |
| Ingrid | 1+1 | 211 Bytes | 02 Sep 2005 - 18:48 |
| DoCoMo | 1+1 | 9.97 KB | 25 Sep 2005 - 11:49 |
| Openfind data gatherer | 1+1 | 211 Bytes | 28 Sep 2005 - 14:43 |
| BBot | 2 | 88.39 KB | 06 Sep 2005 - 03:57 |
| InsurancoBot | 1+1 | 9.22 KB | 04 Sep 2005 - 12:46 |
| ActiveBookmark | 1 | 139 Bytes | 10 Sep 2005 - 19:00 |
| Python-urllib | 0+1 | 72 Bytes | 24 Sep 2005 - 12:50 |
| Netcraft | 1 | 0 | 11 Sep 2005 - 20:27 |
| Powermarks | 1 | 0 | 29 Sep 2005 - 11:55 |
| Wild Ferret Web Hopper #1, #2, #3 | 1 | 139 Bytes | 27 Sep 2005 - 01:20 |
| TITAN | 0+1 | 72 Bytes | 01 Sep 2005 - 01:32 |
| Exabot | 1 | 0 | 16 Sep 2005 - 08:16 |
| larbin | 1 | 532.19 KB | 04 Sep 2005 - 07:24 |
| Miva | 0+1 | 72 Bytes | 27 Sep 2005 - 08:19 |
| Others | 0 | 3.94 KB | |