| 84 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 337299+69 | 24.76 GB | 30 Apr 2006 - 02:57 |
| Yahoo Slurp | 32065+2762 | 27.18 GB | 30 Apr 2006 - 03:07 |
| Unknown robot (identified by 'crawl') | 17890+557 | 10.26 GB | 30 Apr 2006 - 02:59 |
| MSNBot | 16186+711 | 31.95 GB | 30 Apr 2006 - 02:49 |
| Ask | 10989+142 | 340.49 MB | 30 Apr 2006 - 02:18 |
| Heritrix | 3123+4 | 2.72 GB | 26 Apr 2006 - 03:04 |
| Python-urllib | 2571 | 16.40 MB | 09 Apr 2006 - 12:22 |
| Ocelli | 2528+2 | 1.62 GB | 29 Apr 2006 - 17:55 |
| BecomeBot | 2273+144 | 24.24 MB | 29 Apr 2006 - 02:42 |
| Nutch | 1681+20 | 14.45 MB | 29 Apr 2006 - 23:43 |
| UdmSearch | 1587 | 1.65 MB | 04 Apr 2006 - 19:28 |
| GigaBot | 945+602 | 232.82 MB | 29 Apr 2006 - 01:14 |
| ZyBorg | 1324+9 | 12.66 MB | 20 Apr 2006 - 21:05 |
| Voyager | 1011+20 | 10.47 MB | 25 Apr 2006 - 21:41 |
| Unknown robot (identified by empty user agent string) | 548+75 | 330.72 MB | 30 Apr 2006 - 01:01 |
| Unknown robot (identified by 'robot') | 519+4 | 53.35 MB | 29 Apr 2006 - 11:00 |
| Unknown robot (identified by 'bot*') | 343+48 | 39.13 MB | 29 Apr 2006 - 12:13 |
| Harvest | 326 | 99.95 MB | 29 Apr 2006 - 03:51 |
| MJ12bot | 304+13 | 47.79 MB | 25 Apr 2006 - 21:49 |
| WGet tools | 264+2 | 190.26 MB | 29 Apr 2006 - 23:06 |
| SBIder | 95+82 | 363.46 KB | 29 Apr 2006 - 15:01 |
| Java (Often spam bot) | 158+7 | 865.19 KB | 29 Apr 2006 - 23:07 |
| ConveraCrawler | 153+5 | 229.51 MB | 29 Apr 2006 - 01:58 |
| Unknown robot (identified by hit on 'robots.txt') | 0+152 | 10.62 KB | 29 Apr 2006 - 14:21 |
| Turn It In | 132+2 | 7.22 MB | 29 Apr 2006 - 19:37 |
| ichiro | 103+25 | 847.20 KB | 29 Apr 2006 - 20:16 |
| Exabot | 95+14 | 843.38 KB | 25 Apr 2006 - 16:14 |
| Combine System | 41+41 | 266.82 KB | 29 Apr 2006 - 20:56 |
| NutchCVS | 42+28 | 38.30 MB | 28 Apr 2006 - 08:19 |
| Spiderman | 67 | 584.20 KB | 29 Apr 2006 - 16:04 |
| Perl tool | 67 | 63.84 MB | 30 Apr 2006 - 02:19 |
| Unknown robot (identified by 'discovery') | 57 | 0 | 28 Apr 2006 - 17:13 |
| IBM Almaden Research Center WebFountain™ | 29+26 | 2.50 MB | 29 Apr 2006 - 22:37 |
| BaiDuSpider | 43+11 | 9.90 MB | 29 Apr 2006 - 14:24 |
| psbot | 28+22 | 121.27 KB | 29 Apr 2006 - 01:30 |
| noxtrumbot | 41+5 | 349.96 KB | 30 Apr 2006 - 00:35 |
| lanshanbot | 25+19 | 3.41 MB | 27 Apr 2006 - 05:48 |
| Findlinks | 33+10 | 108.76 KB | 28 Apr 2006 - 20:46 |
| Voila | 15+17 | 836.89 KB | 29 Apr 2006 - 00:28 |
| Cursor | 26 | 3.16 MB | 24 Apr 2006 - 15:44 |
| Girafabot | 16+10 | 2.71 MB | 16 Apr 2006 - 22:15 |
| Jakarta commons-httpclient | 25 | 23.78 MB | 29 Apr 2006 - 10:08 |
| Custo | 23 | 50.78 MB | 28 Apr 2006 - 12:10 |
| nicebot | 20 | 190.13 KB | 28 Apr 2006 - 09:43 |
| Sogou Spider | 20 | 5.24 MB | 18 Apr 2006 - 04:50 |
| Geniebot | 9+10 | 387.95 KB | 28 Apr 2006 - 12:30 |
| WebCollage | 18 | 6.71 MB | 26 Apr 2006 - 08:41 |
| CFNetwork | 17 | 127.73 MB | 28 Apr 2006 - 14:24 |
| Google AdSense | 15 | 2.09 MB | 27 Apr 2006 - 16:39 |
| Unknown robot (identified by 'spider') | 6+6 | 210.36 KB | 29 Apr 2006 - 23:32 |
| aipbot | 6+6 | 68.23 KB | 28 Apr 2006 - 05:29 |
| Unknown robot (identified by 'checker') | 9+2 | 185.31 KB | 25 Apr 2006 - 10:13 |
| UCSD Crawl | 11 | 735.34 KB | 20 Apr 2006 - 14:13 |
| Yahoo-MMCrawler | 5+6 | 432 Bytes | 28 Apr 2006 - 09:17 |
| NPBot | 6+2 | 54.70 KB | 23 Apr 2006 - 22:14 |
| Sina Iask Spider | 8 | 921.68 KB | 19 Apr 2006 - 13:06 |
| Shim-Crawler | 4+3 | 243.32 KB | 24 Apr 2006 - 17:51 |
| Web Core / Roots | 5+1 | 30.67 KB | 18 Apr 2006 - 15:06 |
| Vagabondo | 3+2 | 18.41 KB | 23 Apr 2006 - 09:57 |
| Krugle | 2+2 | 19.28 KB | 24 Apr 2006 - 21:57 |
| HTTrack off-line browser | 3+1 | 72.33 KB | 21 Apr 2006 - 07:40 |
| BBot | 4 | 48.94 KB | 14 Apr 2006 - 00:55 |
| Powermarks | 4 | 0 | 25 Apr 2006 - 00:36 |
| Esther | 2+2 | 22.01 MB | 25 Apr 2006 - 10:07 |
| Unknown robot (identified by '*bot') | 2+2 | 350 Bytes | 26 Apr 2006 - 22:11 |
| larbin | 2+2 | 33.38 KB | 24 Apr 2006 - 05:01 |
| Kevin | 3 | 26.87 KB | 04 Apr 2006 - 07:54 |
| Openfind data gatherer | 3 | 21.91 KB | 20 Apr 2006 - 05:34 |
| Scooter | 0+3 | 216 Bytes | 26 Apr 2006 - 01:23 |
| Ingrid | 1+1 | 15.72 KB | 06 Apr 2006 - 23:59 |
| InfoSeek Robot 1.0 | 1+1 | 9.64 KB | 11 Apr 2006 - 09:23 |
| Netcraft | 2 | 0 | 07 Apr 2006 - 23:55 |
| Fast-Webcrawler | 0+2 | 144 Bytes | 06 Apr 2006 - 11:38 |
| The web archive (IA Archiver) | 0+2 | 144 Bytes | 10 Apr 2006 - 02:17 |
| Scumbot | 1+1 | 211 Bytes | 15 Apr 2006 - 13:48 |
| MSIECrawler | 0+2 | 144 Bytes | 21 Apr 2006 - 12:07 |
| Robozilla | 1 | 139 Bytes | 28 Apr 2006 - 15:09 |
| StackRambler | 0+1 | 72 Bytes | 26 Apr 2006 - 03:07 |
| boitho.com-dc | 1 | 1.87 KB | 03 Apr 2006 - 20:33 |
| HTMLParser | 1 | 9.05 KB | 02 Apr 2006 - 12:30 |
| LinkChecker | 1 | 0 | 16 Apr 2006 - 04:49 |
| Others | 0 | 159 Bytes | |