| 84 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 112175+76 | 59.24 GB | 30 Jun 2006 - 23:55 |
| Yahoo Slurp | 36168+3227 | 34.87 GB | 30 Jun 2006 - 23:59 |
| Unknown robot (identified by 'crawl') | 34175+632 | 45.01 GB | 30 Jun 2006 - 23:59 |
| Ask | 29655+245 | 526.29 MB | 30 Jun 2006 - 23:53 |
| MSNBot | 14345+766 | 19.54 GB | 30 Jun 2006 - 23:59 |
| WebReaper | 9084+2 | 18.86 GB | 30 Jun 2006 - 19:44 |
| Python-urllib | 3729 | 78.04 MB | 29 Jun 2006 - 17:30 |
| Ocelli | 2500+2 | 1.32 GB | 12 Jun 2006 - 21:01 |
| BecomeBot | 2085+109 | 22.16 MB | 30 Jun 2006 - 12:48 |
| Nutch | 1579+22 | 13.62 MB | 30 Jun 2006 - 23:58 |
| Voyager | 1179+23 | 12.94 MB | 30 Jun 2006 - 23:57 |
| Unknown robot (identified by empty user agent string) | 1028+60 | 392.38 MB | 30 Jun 2006 - 23:03 |
| IRLbot | 791+12 | 11.30 MB | 22 Jun 2006 - 06:28 |
| ConveraCrawler | 573+8 | 943.02 MB | 30 Jun 2006 - 03:31 |
| Heritrix | 534+1 | 34.23 MB | 28 Jun 2006 - 02:53 |
| Unknown robot (identified by 'bot*') | 329+197 | 65.36 MB | 30 Jun 2006 - 19:20 |
| aipbot | 458+10 | 4.47 MB | 28 Jun 2006 - 23:40 |
| ZyBorg | 423+10 | 5.95 MB | 30 Jun 2006 - 16:39 |
| larbin | 308+68 | 16.54 MB | 29 Jun 2006 - 01:49 |
| Unknown robot (identified by hit on 'robots.txt') | 0+262 | 18.07 KB | 30 Jun 2006 - 20:27 |
| WGet tools | 235+9 | 203.63 MB | 29 Jun 2006 - 13:18 |
| Java (Often spam bot) | 239+3 | 28.41 MB | 30 Jun 2006 - 05:08 |
| Alexa (IA Archiver) | 193+25 | 123.39 MB | 27 Jun 2006 - 20:52 |
| Combine System | 77+79 | 491.69 KB | 29 Jun 2006 - 21:48 |
| GigaBot | 77+46 | 26.79 MB | 28 Jun 2006 - 12:49 |
| Harvest | 118 | 11.16 MB | 30 Jun 2006 - 05:21 |
| NutchCVS | 75+21 | 40.16 MB | 30 Jun 2006 - 10:39 |
| Turn It In | 92+1 | 18.56 MB | 24 Jun 2006 - 01:02 |
| ichiro | 65+8 | 599.12 KB | 14 Jun 2006 - 13:37 |
| lanshanbot | 38+32 | 1.16 MB | 29 Jun 2006 - 14:46 |
| Custo | 67 | 45.41 MB | 29 Jun 2006 - 08:56 |
| MSNBot-media | 42+24 | 5.89 MB | 30 Jun 2006 - 09:49 |
| Perl tool | 62 | 84.53 MB | 30 Jun 2006 - 21:21 |
| Unknown robot (identified by 'robot') | 24+33 | 5.13 MB | 30 Jun 2006 - 06:08 |
| Exabot | 39+11 | 453.15 KB | 28 Jun 2006 - 19:32 |
| Geniebot | 31+16 | 1.58 MB | 29 Jun 2006 - 16:58 |
| psbot | 23+19 | 177.74 KB | 30 Jun 2006 - 20:15 |
| KnowItAll | 5+31 | 51.32 KB | 07 Jun 2006 - 13:46 |
| CFNetwork | 34 | 252.94 MB | 30 Jun 2006 - 15:37 |
| The web archive (IA Archiver) | 2+30 | 2.99 MB | 29 Jun 2006 - 01:40 |
| Voila | 14+18 | 7.19 MB | 23 Jun 2006 - 21:16 |
| Sogou Spider | 31 | 2.26 MB | 30 Jun 2006 - 16:58 |
| Unknown robot (identified by 'spider') | 25+5 | 2.87 MB | 26 Jun 2006 - 08:36 |
| Unknown robot (identified by 'discovery') | 25 | 0 | 30 Jun 2006 - 10:04 |
| nicebot | 25 | 232.97 KB | 30 Jun 2006 - 19:49 |
| SBIder | 11+14 | 127.59 KB | 30 Jun 2006 - 11:38 |
| MJ12bot | 23+2 | 365.62 KB | 03 Jun 2006 - 19:12 |
| SuperBot | 22 | 7.31 MB | 25 Jun 2006 - 16:38 |
| BaiDuSpider | 13+6 | 2.22 MB | 26 Jun 2006 - 23:59 |
| UdmSearch | 15+3 | 840.43 KB | 09 Jun 2006 - 01:45 |
| Findlinks | 11+7 | 975.84 KB | 28 Jun 2006 - 19:34 |
| MSIECrawler | 15+3 | 6.35 MB | 28 Jun 2006 - 20:43 |
| noxtrumbot | 11+5 | 1.50 MB | 14 Jun 2006 - 16:27 |
| Digger | 10+3 | 115.39 KB | 19 Jun 2006 - 05:37 |
| Girafabot | 8+5 | 1.44 MB | 10 Jun 2006 - 04:47 |
| Yahoo-MMCrawler | 7+5 | 360 Bytes | 30 Jun 2006 - 06:17 |
| Web Core / Roots | 8+3 | 114.57 KB | 28 Jun 2006 - 07:42 |
| Cursor | 11 | 3.01 MB | 18 Jun 2006 - 04:35 |
| Sina Iask Spider | 10 | 923.02 KB | 28 Jun 2006 - 14:34 |
| RoboCrawl Spider | 4+5 | 41.87 KB | 22 Jun 2006 - 12:28 |
| ASpider (Associative Spider) | 3+3 | 633 Bytes | 29 Jun 2006 - 16:43 |
| Shim-Crawler | 4+2 | 57.74 KB | 17 Jun 2006 - 00:26 |
| Unknown robot (identified by 'checker') | 6 | 425.03 KB | 30 Jun 2006 - 10:00 |
| Walhello appie | 3+3 | 10.22 KB | 20 Jun 2006 - 07:06 |
| topicblogs | 2+2 | 57.52 KB | 27 Jun 2006 - 05:14 |
| Openfind data gatherer | 3+1 | 18.91 KB | 23 Jun 2006 - 11:43 |
| StackRambler | 0+4 | 288 Bytes | 28 Jun 2006 - 18:09 |
| Powermarks | 4 | 0 | 27 Jun 2006 - 03:58 |
| Jakarta commons-httpclient | 3 | 719.12 KB | 26 Jun 2006 - 03:26 |
| EasyDL | 3 | 50.16 KB | 28 Jun 2006 - 01:34 |
| Scooter | 0+3 | 216 Bytes | 18 Jun 2006 - 00:04 |
| Yahoo-Blogs | 1+1 | 5.27 MB | 19 Jun 2006 - 07:12 |
| GoForIt.com | 1+1 | 211 Bytes | 16 Jun 2006 - 03:09 |
| BBot | 2 | 435.93 KB | 28 Jun 2006 - 08:18 |
| Bloglines | 2 | 726.22 KB | 11 Jun 2006 - 03:24 |
| updated | 1+1 | 211 Bytes | 09 Jun 2006 - 02:57 |
| LinkChecker | 1+1 | 17.09 KB | 25 Jun 2006 - 10:52 |
| Google AdSense | 2 | 14.64 KB | 24 Jun 2006 - 01:54 |
| W3C Link Checker | 1+1 | 72 Bytes | 23 Jun 2006 - 20:03 |
| WordPress | 1 | 0 | 18 Jun 2006 - 04:02 |
| lwp-request | 1 | 139 Bytes | 16 Jun 2006 - 03:45 |
| Fish search | 1 | 718.85 KB | 15 Jun 2006 - 00:26 |
| NG 2.x (Exalead) | 0+1 | 72 Bytes | 11 Jun 2006 - 17:38 |
| arks | 0+1 | 72 Bytes | 06 Jun 2006 - 13:36 |