| 83 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 142384+286 | 59.88 GB | 28 Feb 2006 - 23:59 |
| Unknown robot (identified by 'crawl') | 12582+533 | 7.23 GB | 28 Feb 2006 - 23:58 |
| Yahoo Slurp | 15681+1626 | 15.52 GB | 28 Feb 2006 - 23:58 |
| ZyBorg | 5+7 | 223.41 KB | 28 Feb 2006 - 23:45 |
| MSNBot | 12589+607 | 22.24 GB | 28 Feb 2006 - 23:39 |
| Java (Often spam bot) | 138+8 | 18.96 MB | 28 Feb 2006 - 23:23 |
| NutchCVS | 28+51 | 2.22 MB | 28 Feb 2006 - 21:59 |
| Findlinks | 39+15 | 185.74 KB | 28 Feb 2006 - 21:49 |
| Exabot | 152+24 | 1004.51 KB | 28 Feb 2006 - 21:22 |
| Unknown robot (identified by empty user agent string) | 356+27 | 114.58 MB | 28 Feb 2006 - 20:48 |
| CFNetwork | 19 | 251.33 MB | 28 Feb 2006 - 20:26 |
| BecomeBot | 1809+120 | 17.49 MB | 28 Feb 2006 - 20:21 |
| Python-urllib | 19 | 11.56 MB | 28 Feb 2006 - 19:09 |
| Fast-Webcrawler | 48 | 12.48 MB | 28 Feb 2006 - 19:05 |
| Ask | 5912+58 | 79.22 MB | 28 Feb 2006 - 16:31 |
| IRLbot | 14+11 | 434.09 KB | 28 Feb 2006 - 14:03 |
| Unknown robot (identified by hit on 'robots.txt') | 0+165 | 11.60 KB | 28 Feb 2006 - 13:28 |
| Yahoo-MMCrawler | 8+19 | 17.70 KB | 28 Feb 2006 - 11:53 |
| yoogliFetchAgent | 1 | 10.24 KB | 28 Feb 2006 - 11:11 |
| Combine System | 67+63 | 429.38 KB | 28 Feb 2006 - 10:42 |
| BaiDuSpider | 56+9 | 9.84 MB | 28 Feb 2006 - 07:21 |
| Unknown robot (identified by 'checker') | 7 | 286.27 KB | 28 Feb 2006 - 07:06 |
| ConveraCrawler | 1671+10 | 4.49 GB | 28 Feb 2006 - 06:54 |
| psbot | 205+69 | 5.09 MB | 28 Feb 2006 - 05:46 |
| Shim-Crawler | 3+3 | 633 Bytes | 28 Feb 2006 - 05:33 |
| Unknown robot (identified by 'bot*') | 264+68 | 15.66 MB | 28 Feb 2006 - 04:21 |
| Harvest | 145+1 | 38.89 MB | 28 Feb 2006 - 03:19 |
| HTMLParser | 15 | 67.74 MB | 28 Feb 2006 - 01:32 |
| Ingrid | 1+1 | 15.72 KB | 28 Feb 2006 - 00:20 |
| Nutch | 4761+21 | 41.10 MB | 27 Feb 2006 - 21:21 |
| IBM Almaden Research Center WebFountain™ | 30+19 | 2.51 MB | 27 Feb 2006 - 16:05 |
| Sina Iask Spider | 13 | 1.33 MB | 27 Feb 2006 - 12:53 |
| larbin | 17+14 | 197.03 KB | 27 Feb 2006 - 11:49 |
| GigaBot | 57+44 | 15.49 MB | 27 Feb 2006 - 07:18 |
| Argus | 12+6 | 889.09 KB | 27 Feb 2006 - 04:27 |
| Girafabot | 12+8 | 1.95 MB | 27 Feb 2006 - 03:40 |
| Voila | 12+15 | 149.06 KB | 27 Feb 2006 - 03:12 |
| Powermarks | 5 | 0 | 27 Feb 2006 - 03:09 |
| nicebot | 39 | 384.93 KB | 27 Feb 2006 - 02:32 |
| Google AdSense | 5+1 | 42.41 KB | 27 Feb 2006 - 02:00 |
| Scooter | 0+6 | 432 Bytes | 26 Feb 2006 - 23:02 |
| Voyager | 361+6 | 3.62 MB | 26 Feb 2006 - 19:44 |
| Unknown robot (identified by 'robot') | 506+1 | 321.76 MB | 26 Feb 2006 - 19:10 |
| Alexa (IA Archiver) | 344+30 | 77.41 MB | 26 Feb 2006 - 18:06 |
| Unknown robot (identified by 'spider') | 10+10 | 197.90 KB | 26 Feb 2006 - 12:03 |
| Scumbot | 1+1 | 211 Bytes | 26 Feb 2006 - 08:04 |
| Turn It In | 201+2 | 1.12 GB | 26 Feb 2006 - 03:33 |
| Walhello appie | 28+8 | 243.67 KB | 25 Feb 2006 - 19:43 |
| ichiro | 97+13 | 759.01 KB | 25 Feb 2006 - 18:47 |
| Unknown robot (identified by 'discovery') | 65 | 0 | 25 Feb 2006 - 12:51 |
| BlogSearch | 11 | 681.14 KB | 25 Feb 2006 - 10:39 |
| Perl tool | 89+1 | 18.68 MB | 24 Feb 2006 - 22:02 |
| Gaisbot | 16+13 | 1.96 MB | 24 Feb 2006 - 08:11 |
| WGet tools | 9+2 | 30.67 MB | 24 Feb 2006 - 03:07 |
| Custo | 16 | 8.14 MB | 22 Feb 2006 - 23:26 |
| Openfind data gatherer | 2+2 | 6.28 KB | 22 Feb 2006 - 23:19 |
| MSIECrawler | 9+3 | 5.11 MB | 22 Feb 2006 - 22:02 |
| HTTrack off-line browser | 4 | 139 Bytes | 22 Feb 2006 - 02:33 |
| aipbot | 57+3 | 509.42 KB | 21 Feb 2006 - 06:39 |
| ConveraMultiMediaCrawler | 1+1 | 72 Bytes | 20 Feb 2006 - 23:10 |
| InfoSeek Robot 1.0 | 1+1 | 9.64 KB | 19 Feb 2006 - 13:27 |
| Cursor | 1 | 1.17 MB | 19 Feb 2006 - 09:59 |
| ObjectsSearch | 3+3 | 97.56 KB | 16 Feb 2006 - 19:29 |
| Sogou Spider | 11 | 2.54 MB | 16 Feb 2006 - 11:18 |
| Spiderman | 4 | 13.16 KB | 15 Feb 2006 - 17:35 |
| Jakarta commons-httpclient | 93 | 102.09 MB | 14 Feb 2006 - 23:46 |
| Vagabondo | 1+1 | 211 Bytes | 14 Feb 2006 - 16:54 |
| UCSD Crawl | 5 | 3.01 MB | 14 Feb 2006 - 08:46 |
| lwp-trivial | 2 | 278 Bytes | 14 Feb 2006 - 04:47 |
| MJ12bot | 19+3 | 1003.24 KB | 12 Feb 2006 - 10:27 |
| BBot | 5 | 73.01 KB | 11 Feb 2006 - 20:23 |
| MSRBOT | 1+1 | 7.65 KB | 10 Feb 2006 - 13:12 |
| HooWWWer | 1+1 | 211 Bytes | 09 Feb 2006 - 10:03 |
| Hylanda | 3+1 | 663.06 KB | 08 Feb 2006 - 03:26 |
| UdmSearch | 273 | 114.11 KB | 07 Feb 2006 - 15:53 |
| Geniebot | 1+1 | 8.48 KB | 07 Feb 2006 - 08:09 |
| Web Core / Roots | 1+1 | 211 Bytes | 05 Feb 2006 - 18:08 |
| RufusBot Rufus Web Miner | 5+1 | 43.83 KB | 03 Feb 2006 - 10:18 |
| Netcraft | 2 | 0 | 03 Feb 2006 - 03:54 |
| archive.org bot | 3+1 | 46.20 KB | 02 Feb 2006 - 19:44 |
| Cfetch | 1 | 0 | 02 Feb 2006 - 08:06 |
| Others | 0 | 767 Bytes | |