| 88 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 23036+92 | 41.40 GB | 30 Nov 2006 - 23:59 |
| Python-urllib | 4661 | 8.54 MB | 30 Nov 2006 - 23:59 |
| Yahoo Slurp | 29703+2325 | 15.86 GB | 30 Nov 2006 - 23:58 |
| Unknown robot (identified by 'crawl') | 31888+718 | 31.32 GB | 30 Nov 2006 - 23:46 |
| Perl tool | 255+22 | 11.83 MB | 30 Nov 2006 - 23:45 |
| Gaisbot | 5+4 | 32.85 KB | 30 Nov 2006 - 23:43 |
| Sogou Spider | 105+18 | 49.45 MB | 30 Nov 2006 - 23:36 |
| HTTrack off-line browser | 64+24 | 16.49 MB | 30 Nov 2006 - 23:36 |
| MSNBot | 5192+628 | 7.43 GB | 30 Nov 2006 - 23:28 |
| Java (Often spam bot) | 35+9 | 16.38 MB | 30 Nov 2006 - 23:16 |
| Unknown robot (identified by empty user agent string) | 867+24 | 327.55 MB | 30 Nov 2006 - 23:09 |
| Unknown robot (identified by 'bot*') | 962+62 | 38.71 MB | 30 Nov 2006 - 23:08 |
| Ask | 11385+134 | 181.09 MB | 30 Nov 2006 - 23:06 |
| ASpider (Associative Spider) | 36+21 | 174.04 KB | 30 Nov 2006 - 23:05 |
| MSNBot-media | 3319+85 | 813.04 MB | 30 Nov 2006 - 22:50 |
| Unknown robot (identified by hit on 'robots.txt') | 0+346 | 22.92 KB | 30 Nov 2006 - 21:54 |
| twiceler | 0+1 | 72 Bytes | 30 Nov 2006 - 21:51 |
| NutchCVS | 4798+17 | 1.79 GB | 30 Nov 2006 - 20:38 |
| Alexa (IA Archiver) | 2215+31 | 3.96 GB | 30 Nov 2006 - 20:22 |
| Voila | 41+50 | 2.77 MB | 30 Nov 2006 - 19:01 |
| KnowItAll | 29+19 | 94.61 MB | 30 Nov 2006 - 16:34 |
| BaiDuSpider | 105+9 | 10.81 MB | 30 Nov 2006 - 16:22 |
| UCSD Crawl | 12 | 17.96 MB | 30 Nov 2006 - 16:21 |
| CFNetwork | 51 | 419.80 MB | 30 Nov 2006 - 15:57 |
| Exabot | 148+26 | 1.20 MB | 30 Nov 2006 - 15:42 |
| WGet tools | 30+2 | 30.58 MB | 30 Nov 2006 - 14:59 |
| Yandex bot | 8+12 | 1.93 KB | 30 Nov 2006 - 13:10 |
| psbot | 26+17 | 466.31 KB | 30 Nov 2006 - 12:29 |
| Findlinks | 4+30 | 15.09 KB | 30 Nov 2006 - 10:52 |
| Jakarta commons-httpclient | 40+1 | 98.22 MB | 30 Nov 2006 - 09:36 |
| Sina Iask Spider | 69+2 | 8.79 MB | 30 Nov 2006 - 07:59 |
| Custo | 20 | 44.87 MB | 30 Nov 2006 - 07:14 |
| ZyBorg | 257+11 | 3.27 MB | 30 Nov 2006 - 06:32 |
| GigaBot | 26+32 | 2.60 MB | 30 Nov 2006 - 06:28 |
| BBot | 17 | 15.41 MB | 30 Nov 2006 - 03:00 |
| noxtrumbot | 4916+12 | 3.48 GB | 30 Nov 2006 - 02:21 |
| Unknown robot (identified by 'robot') | 24+21 | 181.54 KB | 30 Nov 2006 - 01:02 |
| Combine System | 16+7 | 4.30 MB | 30 Nov 2006 - 00:56 |
| lwp-trivial | 8 | 13.84 MB | 30 Nov 2006 - 00:12 |
| ichiro | 1854+10 | 98.05 MB | 29 Nov 2006 - 13:19 |
| Unknown robot (identified by 'spider') | 41+11 | 7.89 MB | 29 Nov 2006 - 10:10 |
| The World Wide Web Worm | 2 | 15.77 KB | 29 Nov 2006 - 06:12 |
| nicebot | 49 | 2.04 MB | 29 Nov 2006 - 03:19 |
| Heritrix | 28+4 | 138.86 MB | 29 Nov 2006 - 01:35 |
| Powermarks | 5 | 0 | 29 Nov 2006 - 00:47 |
| MJ12bot | 1316+9 | 16.49 MB | 28 Nov 2006 - 22:58 |
| BecomeBot | 537+26 | 5.62 MB | 28 Nov 2006 - 17:28 |
| Unknown robot (identified by 'discovery') | 17 | 0 | 28 Nov 2006 - 16:07 |
| Harvest | 834 | 99.90 MB | 28 Nov 2006 - 12:17 |
| Turn It In | 495+2 | 638.53 MB | 28 Nov 2006 - 05:07 |
| Nutch | 81+34 | 30.29 MB | 27 Nov 2006 - 13:56 |
| INFOMINE VLCrawler | 3034+1 | 26.10 MB | 27 Nov 2006 - 01:00 |
| YahooSeeker Yahoo! Blog crawler | 29+1 | 22.85 MB | 26 Nov 2006 - 20:46 |
| Voyager | 135+16 | 1.24 MB | 26 Nov 2006 - 12:36 |
| Openfind data gatherer | 4 | 31.83 KB | 26 Nov 2006 - 08:48 |
| Girafabot | 8+5 | 1.08 MB | 26 Nov 2006 - 00:17 |
| W3C Validator | 1 | 9.68 KB | 25 Nov 2006 - 08:10 |
| ConveraCrawler | 1635+6 | 5.48 GB | 25 Nov 2006 - 00:05 |
| EasyDL | 1 | 239.98 KB | 24 Nov 2006 - 13:22 |
| aipbot | 7+5 | 55.08 KB | 24 Nov 2006 - 05:51 |
| The web archive (IA Archiver) | 1+4 | 111.42 KB | 23 Nov 2006 - 11:27 |
| Shim-Crawler | 1+1 | 5.49 KB | 23 Nov 2006 - 11:08 |
| lanshanbot | 51+34 | 8.73 MB | 22 Nov 2006 - 15:14 |
| MSIECrawler | 7+5 | 1.59 MB | 22 Nov 2006 - 14:13 |
| Fish search | 2 | 776.11 KB | 22 Nov 2006 - 00:52 |
| Asterias | 1+1 | 211 Bytes | 22 Nov 2006 - 00:52 |
| InfoSeek Robot 1.0 | 1 | 1.62 MB | 21 Nov 2006 - 23:06 |
| Pompos | 0+2 | 144 Bytes | 21 Nov 2006 - 00:49 |
| larbin | 8+6 | 1.39 MB | 20 Nov 2006 - 17:17 |
| Speedy Spider | 156+8 | 80.45 MB | 20 Nov 2006 - 14:25 |
| HTMLParser | 1 | 10.83 KB | 20 Nov 2006 - 12:46 |
| MojeekBot | 1+1 | 4.31 KB | 20 Nov 2006 - 09:51 |
| Unknown robot (identified by 'checker') | 2 | 169.03 KB | 20 Nov 2006 - 09:22 |
| Accoona-AI-Agent | 2762+3 | 63.37 MB | 19 Nov 2006 - 20:41 |
| Krugle | 7+2 | 35.98 KB | 17 Nov 2006 - 19:50 |
| WebCollage | 11 | 903.14 KB | 14 Nov 2006 - 09:43 |
| NG 1.x (Exalead) | 12 | 107.69 KB | 13 Nov 2006 - 13:06 |
| Checkbot | 5 | 0 | 13 Nov 2006 - 09:50 |
| WordPress | 78 | 422.47 KB | 12 Nov 2006 - 22:12 |
| PyQuery | 2 | 15.27 KB | 12 Nov 2006 - 07:54 |
| Scooter | 0+2 | 144 Bytes | 12 Nov 2006 - 06:27 |
| archive.org bot | 2+2 | 4.07 MB | 10 Nov 2006 - 10:18 |
| Google AdSense | 5 | 87.93 KB | 08 Nov 2006 - 02:45 |
| Netcraft | 3 | 0 | 05 Nov 2006 - 16:56 |
| EARTHCOM.info | 1 | 139 Bytes | 03 Nov 2006 - 19:12 |
| W3C Link Checker | 1+1 | 72 Bytes | 03 Nov 2006 - 13:34 |
| Holmes | 0+1 | 72 Bytes | 01 Nov 2006 - 23:29 |
| WebCopy | 1 | 3.92 MB | 01 Nov 2006 - 02:52 |
| Others | 0 | 0 | |