| 89 different robots | Hits | Bandwidth | Last visit |
|---|
| MSNBot | 17478+2010 | 34.93 GB | 31 Mar 2007 - 23:59 |
| Yahoo Slurp | 50389+3337 | 35.05 GB | 31 Mar 2007 - 23:58 |
| Googlebot | 34925+90 | 72.18 GB | 31 Mar 2007 - 23:57 |
| Unknown robot (identified by empty user agent string) | 1294+47 | 291.00 MB | 31 Mar 2007 - 23:55 |
| Unknown robot (identified by 'crawl') | 31099+884 | 11.76 GB | 31 Mar 2007 - 23:47 |
| EasyDL | 3 | 38.61 MB | 31 Mar 2007 - 23:29 |
| BecomeBot | 2447+215 | 33.19 MB | 31 Mar 2007 - 23:27 |
| Unknown robot (identified by 'bot*') | 1555+209 | 97.71 MB | 31 Mar 2007 - 23:11 |
| Jakarta commons-httpclient | 187 | 13.80 MB | 31 Mar 2007 - 23:09 |
| OutfoxBot/YodaoBot | 147+91 | 69.64 MB | 31 Mar 2007 - 22:58 |
| Alexa (IA Archiver) | 283+40 | 417.20 MB | 31 Mar 2007 - 22:54 |
| Nutch | 3603+75 | 33.45 MB | 31 Mar 2007 - 22:53 |
| CFNetwork | 77 | 411.91 MB | 31 Mar 2007 - 22:46 |
| Unknown robot (identified by hit on 'robots.txt') | 0+320 | 22.50 KB | 31 Mar 2007 - 22:24 |
| Exabot | 194+30 | 26.04 MB | 31 Mar 2007 - 20:59 |
| INFOMINE VLCrawler | 3863+3 | 33.13 MB | 31 Mar 2007 - 20:26 |
| Sina Iask Spider | 546 | 53.41 MB | 31 Mar 2007 - 19:55 |
| boitho.com-dc | 3+2 | 2.04 MB | 31 Mar 2007 - 19:54 |
| MSNBot-media | 13317+189 | 647.70 MB | 31 Mar 2007 - 19:49 |
| Unknown robot (identified by 'spider') | 44+17 | 13.22 MB | 31 Mar 2007 - 19:18 |
| IRLbot | 824+25 | 16.06 MB | 31 Mar 2007 - 19:08 |
| Geniebot | 3+4 | 13.20 KB | 31 Mar 2007 - 17:47 |
| nicebot | 48+6 | 1.34 MB | 31 Mar 2007 - 17:43 |
| Voyager | 12+9 | 4.11 MB | 31 Mar 2007 - 17:09 |
| Java (Often spam bot) | 368+9 | 45.89 MB | 31 Mar 2007 - 15:58 |
| Ask | 9762+127 | 165.02 MB | 31 Mar 2007 - 14:50 |
| GigaBot | 13+13 | 28.70 MB | 31 Mar 2007 - 11:19 |
| Ocelli | 2600+3 | 1.33 GB | 31 Mar 2007 - 11:09 |
| Custo | 66 | 61.74 MB | 31 Mar 2007 - 05:45 |
| BBot | 18 | 52.64 MB | 31 Mar 2007 - 03:58 |
| Perl tool | 295+1 | 37.02 MB | 30 Mar 2007 - 22:58 |
| psbot | 47+41 | 1.47 MB | 30 Mar 2007 - 17:09 |
| Harvest | 664 | 119.85 MB | 30 Mar 2007 - 16:03 |
| RufusBot Rufus Web Miner | 1732+94 | 31.75 MB | 30 Mar 2007 - 14:56 |
| ichiro | 46+2 | 847.43 KB | 30 Mar 2007 - 14:03 |
| Seekbot | 257+9 | 613.75 MB | 30 Mar 2007 - 13:38 |
| Sogou Spider | 199+31 | 83.86 MB | 30 Mar 2007 - 12:17 |
| RoboCrawl Spider | 843+1 | 1.97 MB | 30 Mar 2007 - 11:58 |
| MSIECrawler | 14+24 | 9.05 MB | 30 Mar 2007 - 11:24 |
| WGet tools | 150+2 | 59.47 MB | 30 Mar 2007 - 06:53 |
| Cfetch | 3 | 0 | 30 Mar 2007 - 00:00 |
| MSRBOT | 6+3 | 1.75 MB | 29 Mar 2007 - 23:35 |
| Unknown robot (identified by 'robot') | 25+14 | 649.56 KB | 29 Mar 2007 - 13:03 |
| Heritrix | 7+5 | 4.11 MB | 29 Mar 2007 - 09:28 |
| BaiDuSpider | 42+1 | 72 Bytes | 29 Mar 2007 - 09:24 |
| Yahoo-MMCrawler | 14+10 | 1022 Bytes | 29 Mar 2007 - 04:32 |
| Voila | 218+255 | 37.45 MB | 28 Mar 2007 - 22:20 |
| Combine System | 5+5 | 58.76 KB | 28 Mar 2007 - 20:10 |
| LinkChecker | 4+4 | 42.70 KB | 28 Mar 2007 - 08:59 |
| Unknown robot (identified by '*bot') | 2+4 | 16.17 KB | 28 Mar 2007 - 03:55 |
| Unknown robot (identified by 'discovery') | 46 | 0 | 27 Mar 2007 - 20:15 |
| The web archive (IA Archiver) | 0+19 | 1.34 KB | 27 Mar 2007 - 14:33 |
| QihooBot | 46 | 2.26 MB | 27 Mar 2007 - 13:41 |
| Findlinks | 5+10 | 1.38 KB | 27 Mar 2007 - 12:51 |
| Holmes | 5+10 | 46.05 KB | 27 Mar 2007 - 09:51 |
| W3C Link Checker | 6+6 | 432 Bytes | 26 Mar 2007 - 23:07 |
| arianna.libero.it | 15 | 2.04 KB | 26 Mar 2007 - 12:57 |
| YahooSeeker Yahoo! Blog crawler | 6+4 | 1.69 MB | 26 Mar 2007 - 09:06 |
| The World Wide Web Worm | 4 | 0 | 25 Mar 2007 - 14:17 |
| Web Core / Roots | 6+2 | 7.93 MB | 25 Mar 2007 - 11:37 |
| WebCollage | 20 | 223.45 KB | 25 Mar 2007 - 04:39 |
| ASPseek | 2657+1 | 29.14 MB | 25 Mar 2007 - 00:54 |
| ConveraCrawler | 591+7 | 2.41 GB | 24 Mar 2007 - 22:59 |
| Unknown robot (identified by 'checker') | 7+1 | 7.44 KB | 24 Mar 2007 - 09:26 |
| Fish search | 1 | 267.98 KB | 23 Mar 2007 - 21:11 |
| Krugle | 6+1 | 13.75 MB | 23 Mar 2007 - 03:22 |
| yacy | 1+4 | 411.90 KB | 22 Mar 2007 - 16:56 |
| MJ12bot | 662+12 | 55.65 MB | 22 Mar 2007 - 14:49 |
| HTMLParser | 2 | 278 Bytes | 22 Mar 2007 - 13:37 |
| Speedy Spider | 32+35 | 6.80 KB | 22 Mar 2007 - 00:59 |
| Google AdSense | 4 | 8.06 MB | 21 Mar 2007 - 15:49 |
| Python-urllib | 37+1 | 20.87 MB | 21 Mar 2007 - 12:06 |
| larbin | 7+8 | 1.52 MB | 20 Mar 2007 - 15:28 |
| Powermarks | 2 | 0 | 20 Mar 2007 - 05:18 |
| Accoona-AI-Agent | 53+1 | 151.74 MB | 19 Mar 2007 - 09:59 |
| Digger | 2+2 | 7.73 KB | 18 Mar 2007 - 23:51 |
| Girafabot | 0+8 | 576 Bytes | 17 Mar 2007 - 23:34 |
| HTTrack off-line browser | 2 | 143.69 KB | 17 Mar 2007 - 04:29 |
| TailRank | 4 | 0 | 15 Mar 2007 - 17:36 |
| Kevin | 6 | 2.76 MB | 15 Mar 2007 - 05:04 |
| bender focused_crawler | 5+3 | 48.20 KB | 12 Mar 2007 - 02:56 |
| EARTHCOM.info | 0+1 | 72 Bytes | 08 Mar 2007 - 19:05 |
| Hylanda | 1+1 | 860.21 KB | 08 Mar 2007 - 16:41 |
| GoForIt.com | 1+1 | 211 Bytes | 07 Mar 2007 - 01:06 |
| NutchCVS | 4+1 | 29.58 KB | 04 Mar 2007 - 19:25 |
| noxtrumbot | 2996+3 | 49.35 MB | 03 Mar 2007 - 09:11 |
| UCSD Crawl | 3 | 27.75 KB | 01 Mar 2007 - 08:14 |
| Others | 0 | 1 Bytes | |