| 74 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 58371+229 | 26.67 GB | 28 Feb 2005 - 23:57 |
| Unknown robot (identified by 'crawl') | 17010+491 | 10.26 GB | 28 Feb 2005 - 23:49 |
| MSNBot | 6213+262 | 11.28 GB | 28 Feb 2005 - 23:44 |
| Yahoo Slurp | 8654+1142 | 7.96 GB | 28 Feb 2005 - 22:46 |
| BaiDuSpider | 3399+5 | 35.46 MB | 28 Feb 2005 - 22:23 |
| Unknown robot (identified by empty user agent string) | 325+58 | 74.21 MB | 28 Feb 2005 - 22:16 |
| WGet tools | 19 | 10.12 MB | 28 Feb 2005 - 21:56 |
| Perl tool | 109 | 18.89 MB | 28 Feb 2005 - 21:35 |
| NutchCVS | 13+9 | 43.49 KB | 28 Feb 2005 - 20:23 |
| Unknown robot (identified by 'bot*') | 31+18 | 691.21 KB | 28 Feb 2005 - 19:28 |
| Java (Often spam bot) | 52+4 | 6.31 MB | 28 Feb 2005 - 19:25 |
| Grub.org | 662 | 5.75 MB | 28 Feb 2005 - 18:30 |
| Unknown robot (identified by 'robot') | 68+3 | 3.15 MB | 28 Feb 2005 - 18:21 |
| Harvest | 404 | 66.61 MB | 28 Feb 2005 - 18:01 |
| Fast-Webcrawler | 37+5 | 37.52 KB | 28 Feb 2005 - 17:22 |
| Unknown robot (identified by 'sucker') | 1 | 0 | 28 Feb 2005 - 16:11 |
| Alexa (IA Archiver) | 90+22 | 504.57 KB | 28 Feb 2005 - 15:12 |
| Fish search | 182 | 1.66 MB | 28 Feb 2005 - 13:28 |
| YahooSeeker Yahoo! Blog crawler | 1777+24 | 113.16 MB | 28 Feb 2005 - 11:29 |
| INFOMINE VLCrawler | 244+10 | 208.95 MB | 28 Feb 2005 - 10:48 |
| MJ12bot | 3+2 | 24.84 KB | 28 Feb 2005 - 10:32 |
| Ask | 10488+128 | 128.64 MB | 28 Feb 2005 - 04:43 |
| Powermarks | 3 | 0 | 28 Feb 2005 - 01:08 |
| Heritrix | 199+6 | 3.02 MB | 28 Feb 2005 - 00:39 |
| Unknown robot (identified by 'spider') | 11+10 | 70.81 KB | 27 Feb 2005 - 23:11 |
| Openfind data gatherer | 5+5 | 29.88 KB | 27 Feb 2005 - 22:56 |
| IBM Almaden Research Center WebFountain™ | 9+5 | 1.23 MB | 27 Feb 2005 - 21:32 |
| Custo | 79 | 38.83 MB | 27 Feb 2005 - 14:41 |
| psbot | 8+8 | 65.21 KB | 27 Feb 2005 - 11:39 |
| Jakarta commons-httpclient | 40 | 27.45 MB | 27 Feb 2005 - 06:21 |
| IRLbot | 13+12 | 513.64 KB | 27 Feb 2005 - 01:28 |
| BecomeBot | 36+21 | 1.90 MB | 26 Feb 2005 - 16:45 |
| Findlinks | 4 | 431.98 KB | 26 Feb 2005 - 06:40 |
| Voila | 11+14 | 10.38 MB | 26 Feb 2005 - 00:01 |
| webcrawl.net | 2+2 | 422 Bytes | 25 Feb 2005 - 22:31 |
| Unknown robot (identified by hit on 'robots.txt') | 0+29 | 1.97 KB | 25 Feb 2005 - 19:33 |
| updated | 11+4 | 6.61 MB | 25 Feb 2005 - 19:00 |
| UdmSearch | 1+1 | 0 | 24 Feb 2005 - 22:17 |
| sohu-search | 1499+8 | 7.45 MB | 24 Feb 2005 - 19:38 |
| larbin | 1+1 | 7.24 KB | 24 Feb 2005 - 09:40 |
| JoBo Java Web Robot | 0+1 | 72 Bytes | 24 Feb 2005 - 09:20 |
| Fast-Search-Engine (not fastsearch.com) | 10 | 380.97 KB | 24 Feb 2005 - 08:32 |
| GoForIt.com | 1+1 | 211 Bytes | 24 Feb 2005 - 02:50 |
| Unknown robot (identified by 'checker') | 12 | 162.40 KB | 23 Feb 2005 - 11:02 |
| Yahoo Vertical Crawler | 0+9 | 648 Bytes | 23 Feb 2005 - 07:27 |
| Python-urllib | 4821 | 14.70 GB | 23 Feb 2005 - 06:26 |
| GigaBot | 28+18 | 2.08 MB | 22 Feb 2005 - 17:05 |
| HTTrack off-line browser | 2 | 139 Bytes | 22 Feb 2005 - 00:25 |
| Walhello appie | 137+24 | 1.20 MB | 21 Feb 2005 - 20:14 |
| MSIECrawler | 4+3 | 863.36 KB | 21 Feb 2005 - 19:47 |
| Spiderman | 1 | 5.42 KB | 21 Feb 2005 - 09:47 |
| Gaisbot | 1+1 | 211 Bytes | 21 Feb 2005 - 09:34 |
| FastCrawler | 2+2 | 7.84 MB | 21 Feb 2005 - 00:38 |
| Holmes | 2+1 | 72 Bytes | 20 Feb 2005 - 17:16 |
| lwp-trivial | 13 | 130.18 KB | 19 Feb 2005 - 12:19 |
| PEERbot | 1+1 | 211 Bytes | 19 Feb 2005 - 01:03 |
| Vagabondo | 1+1 | 211 Bytes | 18 Feb 2005 - 00:30 |
| ichiro | 12+1 | 86.87 KB | 17 Feb 2005 - 07:03 |
| boitho.com-dc | 3 | 7.44 KB | 16 Feb 2005 - 21:45 |
| Ultraseek | 1+1 | 211 Bytes | 16 Feb 2005 - 16:37 |
| Google AdSense | 7+3 | 2.09 MB | 16 Feb 2005 - 04:51 |
| Speedy Spider | 2+1 | 211 Bytes | 16 Feb 2005 - 02:03 |
| Unknown robot (identified by 'discovery') | 3 | 0 | 14 Feb 2005 - 17:27 |
| Turn It In | 1+1 | 3.95 MB | 10 Feb 2005 - 11:54 |
| Boris | 1+1 | 7.87 KB | 09 Feb 2005 - 11:19 |
| UCSD Crawl | 7 | 53.86 KB | 08 Feb 2005 - 21:12 |
| Girafabot | 8+4 | 905.02 KB | 08 Feb 2005 - 19:41 |
| lwp-request | 1 | 0 | 07 Feb 2005 - 16:19 |
| CFNetwork | 2 | 447.35 KB | 07 Feb 2005 - 09:10 |
| EasyDL | 1 | 11.01 KB | 06 Feb 2005 - 22:44 |
| IlTrovatore-Setaccio | 3+2 | 7.58 KB | 06 Feb 2005 - 16:31 |
| Yahoo-MMCrawler | 0+9 | 648 Bytes | 05 Feb 2005 - 14:21 |
| Asterias | 1 | 139 Bytes | 03 Feb 2005 - 09:59 |
| The web archive (IA Archiver) | 0+34 | 2.39 KB | 01 Feb 2005 - 05:44 |
| Others | 0 | 7 Bytes | |