| 86 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 94817+491 | 84.64 GB | 31 Jul 2007 - 23:57 |
| Googlebot | 58402+84 | 56.21 GB | 31 Jul 2007 - 23:47 |
| Unknown robot (identified by 'crawl') | 33439+853 | 14.61 GB | 31 Jul 2007 - 23:57 |
| MSNBot | 19283+2211 | 30.01 GB | 31 Jul 2007 - 23:49 |
| Heritrix | 10324+12 | 11.73 GB | 28 Jul 2007 - 21:52 |
| GigaBot | 7658+91 | 23.59 GB | 29 Jul 2007 - 18:33 |
| Ask | 6267+104 | 114.35 MB | 31 Jul 2007 - 11:42 |
| noxtrumbot | 4991+5 | 51.69 MB | 18 Jul 2007 - 05:11 |
| Nutch | 3476+287 | 296.36 MB | 31 Jul 2007 - 21:27 |
| archive.org bot | 3559+14 | 10.09 GB | 24 Jul 2007 - 13:23 |
| INFOMINE VLCrawler | 3223+1 | 27.59 MB | 15 Jul 2007 - 01:23 |
| Unknown robot (identified by 'bot*') | 2728+88 | 55.89 MB | 31 Jul 2007 - 23:57 |
| MSNBot-media | 1110+88 | 38.15 MB | 31 Jul 2007 - 23:18 |
| twiceler | 1126+27 | 11.96 MB | 31 Jul 2007 - 23:59 |
| Unknown robot (identified by empty user agent string) | 759+352 | 398.83 MB | 31 Jul 2007 - 23:45 |
| BecomeBot | 661+288 | 11.75 MB | 31 Jul 2007 - 23:59 |
| BaiDuSpider | 838+9 | 15.14 MB | 31 Jul 2007 - 23:04 |
| Jakarta commons-httpclient | 812+3 | 1.13 GB | 31 Jul 2007 - 03:02 |
| Speedy Spider | 723+86 | 5.01 GB | 31 Jul 2007 - 10:11 |
| ConveraCrawler | 783+3 | 2.95 GB | 14 Jul 2007 - 22:30 |
| Harvest | 746 | 264.37 MB | 30 Jul 2007 - 09:38 |
| Voila | 211+212 | 6.39 MB | 31 Jul 2007 - 22:50 |
| Perl tool | 403+1 | 50.30 MB | 30 Jul 2007 - 13:10 |
| Unknown robot (identified by hit on 'robots.txt') | 0+208 | 14.62 KB | 31 Jul 2007 - 23:25 |
| ichiro | 156+4 | 3.24 MB | 29 Jul 2007 - 13:56 |
| Sogou Spider | 132+27 | 104.60 MB | 31 Jul 2007 - 06:54 |
| NutchCVS | 141+17 | 40.72 MB | 30 Jul 2007 - 13:44 |
| Alexa (IA Archiver) | 139+19 | 98.24 MB | 25 Jul 2007 - 21:21 |
| OutfoxBot/YodaoBot | 98+37 | 13.97 MB | 31 Jul 2007 - 01:20 |
| Unknown robot (identified by 'robot') | 57+55 | 658.72 KB | 31 Jul 2007 - 21:39 |
| The web archive (IA Archiver) | 11+99 | 680.12 KB | 26 Jul 2007 - 00:16 |
| Exabot | 87+20 | 1.84 MB | 31 Jul 2007 - 23:40 |
| Java (Often spam bot) | 101+4 | 81.32 MB | 31 Jul 2007 - 22:03 |
| CFNetwork | 85 | 542.45 MB | 30 Jul 2007 - 13:59 |
| MJ12bot | 77+8 | 875.33 KB | 27 Jul 2007 - 16:46 |
| Ocelli | 59+1 | 7.98 MB | 17 Jul 2007 - 23:35 |
| WGet tools | 54+2 | 40.96 MB | 31 Jul 2007 - 07:35 |
| MSIECrawler | 21+28 | 11.42 MB | 31 Jul 2007 - 18:42 |
| HTTrack off-line browser | 44 | 7.28 MB | 30 Jul 2007 - 23:18 |
| Unknown robot (identified by 'spider') | 27+10 | 435.68 KB | 26 Jul 2007 - 16:12 |
| Gaisbot | 28+9 | 259.54 KB | 24 Jul 2007 - 01:11 |
| Seekbot | 0+31 | 2.18 KB | 15 Jul 2007 - 09:16 |
| VWbot | 15+14 | 10.53 MB | 12 Jul 2007 - 11:16 |
| Yahoo-MMCrawler | 15+13 | 1.21 KB | 28 Jul 2007 - 07:23 |
| IRLbot | 26+1 | 2.24 MB | 28 Jul 2007 - 10:56 |
| Custo | 24 | 72.61 MB | 31 Jul 2007 - 05:39 |
| Internet Shinchakubin | 19 | 123.76 KB | 27 Jul 2007 - 10:44 |
| lanshanbot | 11+6 | 3.49 MB | 31 Jul 2007 - 14:02 |
| yacy | 11+4 | 2.49 MB | 20 Jul 2007 - 19:45 |
| Unknown robot (identified by 'discovery') | 12 | 0 | 27 Jul 2007 - 05:53 |
| WebCollage | 12 | 4.74 MB | 29 Jul 2007 - 10:29 |
| Holmes | 5+5 | 1.11 MB | 31 Jul 2007 - 09:34 |
| nicebot | 8+2 | 318.39 KB | 31 Jul 2007 - 03:17 |
| EasyDL | 10 | 332.44 KB | 07 Jul 2007 - 15:41 |
| Combine System | 4+5 | 61.96 KB | 29 Jul 2007 - 17:55 |
| psbot | 4+4 | 2.32 KB | 02 Jul 2007 - 00:37 |
| BBot | 8 | 24.00 MB | 16 Jul 2007 - 09:34 |
| NG 2.x (Exalead) | 0+8 | 576 Bytes | 17 Jul 2007 - 12:45 |
| QihooBot | 7 | 743.05 KB | 31 Jul 2007 - 05:17 |
| WordPress | 6 | 2.65 MB | 23 Jul 2007 - 22:42 |
| The World Wide Web Worm | 6 | 0 | 28 Jul 2007 - 14:45 |
| lwp-trivial | 6 | 866.01 KB | 31 Jul 2007 - 20:54 |
| Python-urllib | 4+1 | 921.24 KB | 24 Jul 2007 - 17:02 |
| Girafabot | 0+5 | 360 Bytes | 26 Jul 2007 - 00:43 |
| TailRank | 2+2 | 144 Bytes | 08 Jul 2007 - 21:23 |
| Web Core / Roots | 4 | 106.33 KB | 24 Jul 2007 - 09:22 |
| YahooSeeker Yahoo! Blog crawler | 2+2 | 422 Bytes | 17 Jul 2007 - 12:46 |
| Cursor | 3 | 30.75 KB | 25 Jul 2007 - 15:59 |
| UCSD Crawl | 3 | 27.69 KB | 01 Jul 2007 - 11:44 |
| Bloodhound | 1+1 | 211 Bytes | 03 Jul 2007 - 22:48 |
| Sina Iask Spider | 2 | 292.11 KB | 17 Jul 2007 - 05:33 |
| NimbleCrawler | 1+1 | 39.38 KB | 25 Jul 2007 - 18:29 |
| SlySearch | 2 | 278 Bytes | 27 Jul 2007 - 00:51 |
| HTMLParser | 2 | 512.53 KB | 31 Jul 2007 - 09:03 |
| LinkChecker | 2 | 16.11 KB | 31 Jul 2007 - 06:46 |
| SynooBot | 1+1 | 7.56 KB | 26 Jul 2007 - 17:38 |
| larbin | 1+1 | 7.64 KB | 25 Jul 2007 - 18:25 |
| FaceBook bot | 1 | 15.77 KB | 23 Jul 2007 - 00:44 |
| Unknown robot (identified by 'checker') | 1 | 0 | 14 Jul 2007 - 03:05 |
| Fish search | 1 | 179.98 KB | 17 Jul 2007 - 04:50 |
| Powermarks | 1 | 0 | 26 Jul 2007 - 03:51 |
| boitho.com-dc | 1 | 7.80 KB | 01 Jul 2007 - 04:31 |
| Checkbot | 1 | 0 | 20 Jul 2007 - 17:02 |
| Scooter | 0+1 | 72 Bytes | 21 Jul 2007 - 05:40 |
| Google AdSense | 1 | 9.11 KB | 31 Jul 2007 - 00:00 |
| Others | 0 | 8 Bytes | |