| 77 different robots | Hits | Bandwidth | Last visit |
|---|
| aipbot | 941+38 | 6.15 MB | 30 Apr 2005 - 23:56 |
| Googlebot | 65853+243 | 31.56 GB | 30 Apr 2005 - 23:50 |
| Yahoo Slurp | 9935+1264 | 7.47 GB | 30 Apr 2005 - 23:49 |
| ZyBorg | 2852+12 | 24.41 MB | 30 Apr 2005 - 23:47 |
| MSNBot | 5387+377 | 10.60 GB | 30 Apr 2005 - 23:36 |
| KnowItAll | 7+5 | 70.48 KB | 30 Apr 2005 - 23:21 |
| Unknown robot (identified by 'crawl') | 60805+1671 | 294.80 GB | 30 Apr 2005 - 23:17 |
| CFNetwork | 2 | 20.37 MB | 30 Apr 2005 - 22:35 |
| Ask | 4282+83 | 80.46 MB | 30 Apr 2005 - 21:41 |
| Harvest | 298 | 22.55 MB | 30 Apr 2005 - 20:25 |
| Java (Often spam bot) | 1030+6 | 118.47 MB | 30 Apr 2005 - 20:25 |
| Unknown robot (identified by empty user agent string) | 405+51 | 58.67 MB | 30 Apr 2005 - 20:11 |
| Grub.org | 510+5 | 4.35 MB | 30 Apr 2005 - 19:35 |
| Spiderman | 4 | 16.40 KB | 30 Apr 2005 - 18:34 |
| YahooSeeker Yahoo! Blog crawler | 390+27 | 1.55 MB | 30 Apr 2005 - 16:36 |
| Alexa (IA Archiver) | 111+46 | 84.80 MB | 30 Apr 2005 - 16:11 |
| BaiDuSpider | 5037+4 | 56.13 MB | 30 Apr 2005 - 15:24 |
| Scooter | 0+17 | 1.20 KB | 30 Apr 2005 - 07:36 |
| IRLbot | 239+71 | 328.93 KB | 30 Apr 2005 - 02:27 |
| MSIECrawler | 6+1 | 34.51 KB | 30 Apr 2005 - 02:01 |
| IBM Almaden Research Center WebFountain™ | 31+9 | 4.30 MB | 29 Apr 2005 - 23:54 |
| Voila | 14+17 | 2.39 MB | 29 Apr 2005 - 23:20 |
| Jakarta commons-httpclient | 20 | 6.17 MB | 29 Apr 2005 - 19:46 |
| Unknown robot (identified by 'spider') | 8+10 | 16.68 KB | 29 Apr 2005 - 19:07 |
| IlTrovatore-Setaccio | 1+1 | 211 Bytes | 29 Apr 2005 - 17:06 |
| Speedy Spider | 22+11 | 9.30 KB | 29 Apr 2005 - 17:02 |
| Perl tool | 169 | 7.37 MB | 29 Apr 2005 - 15:17 |
| Findlinks | 0+4 | 288 Bytes | 29 Apr 2005 - 12:50 |
| HTTrack off-line browser | 5+1 | 1.75 MB | 29 Apr 2005 - 10:51 |
| MojeekBot | 2+1 | 7.37 KB | 29 Apr 2005 - 07:50 |
| NutchCVS | 18+14 | 76.64 KB | 29 Apr 2005 - 06:43 |
| Unknown robot (identified by hit on 'robots.txt') | 0+35 | 2.46 KB | 29 Apr 2005 - 06:17 |
| Unknown robot (identified by 'bot*') | 196+5 | 1.63 MB | 29 Apr 2005 - 03:51 |
| BecomeBot | 21+9 | 1010.31 KB | 29 Apr 2005 - 03:27 |
| PostFavorites | 2 | 6.07 KB | 28 Apr 2005 - 20:52 |
| WGet tools | 16+4 | 64.79 MB | 28 Apr 2005 - 20:30 |
| Combine System | 6+4 | 64.10 KB | 28 Apr 2005 - 19:30 |
| GigaBot | 41+41 | 15.44 MB | 28 Apr 2005 - 15:27 |
| Unknown robot (identified by 'checker') | 9 | 150.59 KB | 28 Apr 2005 - 07:00 |
| webcrawl.net | 1+1 | 10.62 KB | 28 Apr 2005 - 04:47 |
| Custo | 52 | 29.12 MB | 27 Apr 2005 - 21:38 |
| lwp-trivial | 51 | 530.51 KB | 27 Apr 2005 - 11:01 |
| Fish search | 10 | 105.15 KB | 27 Apr 2005 - 08:53 |
| Unknown robot (identified by 'robot') | 24+3 | 927.79 KB | 26 Apr 2005 - 21:22 |
| Cursor | 34 | 3.25 MB | 26 Apr 2005 - 13:19 |
| psbot | 15+8 | 129.53 KB | 26 Apr 2005 - 13:16 |
| INFOMINE VLCrawler | 9334+18 | 10.41 GB | 26 Apr 2005 - 06:38 |
| VSE | 2+2 | 462.49 KB | 26 Apr 2005 - 04:57 |
| Powermarks | 4 | 0 | 26 Apr 2005 - 02:30 |
| NG 2.x (Exalead) | 174+5 | 1.90 MB | 25 Apr 2005 - 07:48 |
| Google AdSense | 25+9 | 46.77 MB | 25 Apr 2005 - 02:31 |
| Openfind data gatherer | 2+2 | 31.68 KB | 24 Apr 2005 - 04:38 |
| Walhello appie | 4+4 | 1.91 MB | 23 Apr 2005 - 14:40 |
| Nutch | 392+2 | 3.41 MB | 22 Apr 2005 - 16:42 |
| Python-urllib | 1 | 1.45 MB | 21 Apr 2005 - 21:47 |
| Exabot | 36 | 110.84 MB | 21 Apr 2005 - 05:02 |
| sohu-search | 2 | 176.11 KB | 20 Apr 2005 - 18:59 |
| Steeler | 1+3 | 355 Bytes | 20 Apr 2005 - 17:44 |
| Pioneer | 6 | 26.16 KB | 20 Apr 2005 - 08:18 |
| RuLeS | 1 | 159.10 KB | 18 Apr 2005 - 10:42 |
| Unknown robot (identified by 'discovery') | 10 | 0 | 18 Apr 2005 - 04:58 |
| Argus | 1+1 | 211 Bytes | 16 Apr 2005 - 22:27 |
| larbin | 7+5 | 43.31 KB | 16 Apr 2005 - 17:04 |
| EasyDL | 4 | 27.21 KB | 16 Apr 2005 - 01:59 |
| Turn It In | 381+2 | 1.92 GB | 14 Apr 2005 - 16:28 |
| UCSD Crawl | 1 | 3.76 MB | 14 Apr 2005 - 14:44 |
| Unknown robot (identified by 'hunter') | 3 | 34.49 KB | 14 Apr 2005 - 07:56 |
| Gaisbot | 1+1 | 211 Bytes | 11 Apr 2005 - 03:23 |
| Girafabot | 8+4 | 958.60 KB | 10 Apr 2005 - 21:12 |
| RoadHouse Crawling System | 1 | 139 Bytes | 08 Apr 2005 - 22:41 |
| Netcraft | 1 | 0 | 08 Apr 2005 - 03:48 |
| Unknown robot (identified by '*bot') | 1739+1 | 14.95 MB | 07 Apr 2005 - 23:39 |
| HTMLParser | 5 | 53.14 KB | 06 Apr 2005 - 19:05 |
| Cfetch | 16 | 132.71 KB | 04 Apr 2005 - 01:13 |
| Holmes | 0+3 | 216 Bytes | 03 Apr 2005 - 19:34 |
| mnoGoSearch search engine software | 1+1 | 211 Bytes | 03 Apr 2005 - 09:26 |
| UdmSearch | 1707 | 15.43 MB | 01 Apr 2005 - 15:53 |
| Others | 0 | 1 Bytes | |