| 75 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 53045+83 | 59.85 GB | 28 Feb 2007 - 23:58 |
| Yahoo Slurp | 35687+3498 | 19.12 GB | 28 Feb 2007 - 23:59 |
| Unknown robot (identified by 'crawl') | 29569+721 | 20.92 GB | 28 Feb 2007 - 23:55 |
| MSNBot | 21722+1675 | 39.08 GB | 28 Feb 2007 - 23:53 |
| Ask | 16978+157 | 18.28 GB | 28 Feb 2007 - 22:05 |
| Unknown robot (identified by empty user agent string) | 1207+7418 | 285.38 MB | 28 Feb 2007 - 22:47 |
| MSNBot-media | 5234+147 | 497.53 MB | 28 Feb 2007 - 23:18 |
| WGet tools | 4319+1 | 6.46 GB | 28 Feb 2007 - 07:21 |
| Alexa (IA Archiver) | 4049+25 | 8.00 GB | 28 Feb 2007 - 02:52 |
| BecomeBot | 2589+183 | 31.41 MB | 28 Feb 2007 - 23:59 |
| Nutch | 2404+69 | 45.78 MB | 28 Feb 2007 - 23:54 |
| noxtrumbot | 1877+2 | 19.25 MB | 28 Feb 2007 - 23:59 |
| Accoona-AI-Agent | 1827+4 | 62.74 MB | 12 Feb 2007 - 10:57 |
| INFOMINE VLCrawler | 1822+2 | 15.69 MB | 28 Feb 2007 - 00:53 |
| RoboCrawl Spider | 1813+2 | 7.42 MB | 24 Feb 2007 - 10:59 |
| Unknown robot (identified by 'bot*') | 914+151 | 104.13 MB | 28 Feb 2007 - 23:20 |
| ConveraCrawler | 695+5 | 1.06 GB | 24 Feb 2007 - 16:33 |
| ichiro | 477+4 | 6.11 MB | 28 Feb 2007 - 09:03 |
| Voyager | 305+13 | 3.61 MB | 14 Feb 2007 - 16:47 |
| Harvest | 303 | 98.14 MB | 27 Feb 2007 - 22:45 |
| Unknown robot (identified by hit on 'robots.txt') | 0+271 | 18.98 KB | 28 Feb 2007 - 21:07 |
| Geniebot | 248+9 | 2.00 MB | 19 Feb 2007 - 21:14 |
| Exabot | 199+31 | 2.48 MB | 28 Feb 2007 - 22:43 |
| Sogou Spider | 181+46 | 49.50 MB | 28 Feb 2007 - 15:44 |
| Voila | 90+104 | 27.63 MB | 28 Feb 2007 - 21:02 |
| Perl tool | 187+1 | 27.34 MB | 28 Feb 2007 - 19:33 |
| Jakarta commons-httpclient | 135 | 1.37 MB | 28 Feb 2007 - 14:56 |
| Sina Iask Spider | 97 | 5.64 MB | 28 Feb 2007 - 18:16 |
| Shim-Crawler | 51+2 | 463.09 KB | 17 Feb 2007 - 11:30 |
| arianna.libero.it | 49 | 6.65 KB | 09 Feb 2007 - 23:10 |
| CFNetwork | 43 | 544.29 MB | 27 Feb 2007 - 21:43 |
| BaiDuSpider | 42+1 | 7.99 KB | 27 Feb 2007 - 09:11 |
| Java (Often spam bot) | 35+5 | 15.43 MB | 28 Feb 2007 - 14:24 |
| Krugle | 20+12 | 12.66 MB | 18 Feb 2007 - 20:45 |
| OutfoxBot/YodaoBot | 21+10 | 9.15 MB | 28 Feb 2007 - 17:00 |
| Heritrix | 23+8 | 26.72 MB | 22 Feb 2007 - 10:16 |
| Unknown robot (identified by 'spider') | 22+8 | 6.89 MB | 27 Feb 2007 - 17:55 |
| WebCollage | 28 | 268.79 KB | 21 Feb 2007 - 01:39 |
| The web archive (IA Archiver) | 1+23 | 42.96 KB | 25 Feb 2007 - 02:19 |
| YahooSeeker Yahoo! Blog crawler | 13+7 | 7.50 MB | 28 Feb 2007 - 05:20 |
| Yahoo-MMCrawler | 12+8 | 576 Bytes | 24 Feb 2007 - 13:21 |
| MSIECrawler | 11+9 | 37.61 KB | 27 Feb 2007 - 00:25 |
| Findlinks | 4+11 | 44.12 KB | 28 Feb 2007 - 02:28 |
| MJ12bot | 8+7 | 5.69 MB | 18 Feb 2007 - 00:54 |
| Custo | 11 | 8.66 MB | 22 Feb 2007 - 02:57 |
| Unknown robot (identified by 'discovery') | 11 | 0 | 27 Feb 2007 - 08:12 |
| BBot | 10 | 43.44 MB | 27 Feb 2007 - 11:48 |
| Holmes | 1+8 | 7.77 KB | 28 Feb 2007 - 22:10 |
| lwp-trivial | 8 | 37.52 KB | 26 Feb 2007 - 15:31 |
| Unknown robot (identified by 'robot') | 6+2 | 38.09 KB | 22 Feb 2007 - 19:02 |
| Combine System | 3+4 | 51.26 KB | 28 Feb 2007 - 02:50 |
| Girafabot | 0+7 | 504 Bytes | 12 Feb 2007 - 19:18 |
| psbot | 3+3 | 9.67 KB | 28 Feb 2007 - 23:34 |
| EasyDL | 6 | 132.74 KB | 15 Feb 2007 - 11:09 |
| Google AdSense | 6 | 69.13 KB | 22 Feb 2007 - 04:16 |
| GigaBot | 3+2 | 235.71 KB | 10 Feb 2007 - 09:10 |
| The World Wide Web Worm | 5 | 15.77 KB | 23 Feb 2007 - 13:18 |
| UCSD Crawl | 4 | 27.68 KB | 20 Feb 2007 - 13:16 |
| WebFilter | 0+3 | 216 Bytes | 24 Feb 2007 - 19:54 |
| Unknown robot (identified by 'checker') | 3 | 0 | 22 Feb 2007 - 18:50 |
| NutchCVS | 2+1 | 18.67 KB | 24 Feb 2007 - 05:58 |
| TailRank | 2 | 0 | 28 Feb 2007 - 07:22 |
| Web Core / Roots | 1+1 | 211 Bytes | 18 Feb 2007 - 13:08 |
| nicebot | 2 | 18.16 KB | 26 Feb 2007 - 20:01 |
| Python-urllib | 2 | 635.92 KB | 26 Feb 2007 - 03:56 |
| QihooBot | 2 | 9.98 KB | 18 Feb 2007 - 18:01 |
| Fish search | 2 | 480.11 KB | 24 Feb 2007 - 18:12 |
| Checkbot | 0+2 | 144 Bytes | 23 Feb 2007 - 10:58 |
| Gaisbot | 1+1 | 846.93 KB | 12 Feb 2007 - 19:45 |
| larbin | 1+1 | 211 Bytes | 15 Feb 2007 - 11:24 |
| SuperBot | 1 | 139 Bytes | 17 Feb 2007 - 07:54 |
| yacy | 1 | 12.01 KB | 17 Feb 2007 - 22:32 |
| Powermarks | 1 | 0 | 26 Feb 2007 - 06:52 |
| HTMLParser | 1 | 9.39 KB | 24 Feb 2007 - 16:29 |
| Scooter | 0+1 | 72 Bytes | 07 Feb 2007 - 04:35 |