92 different robots | Hits | Bandwidth | Last visit |
Googlebot | 97811+283 | 55.53 GB | 30 Nov 2005 - 23:59 |
Unknown robot (identified by 'crawl') | 18073+597 | 12.42 GB | 30 Nov 2005 - 23:44 |
Yahoo Slurp | 10555+1281 | 5.85 GB | 30 Nov 2005 - 23:50 |
MSNBot | 6087+307 | 9.55 GB | 30 Nov 2005 - 23:59 |
Ask | 4185+124 | 94.44 MB | 30 Nov 2005 - 22:35 |
Nutch | 3264+11 | 28.11 MB | 28 Nov 2005 - 23:05 |
Ocelli | 2528+2 | 1.63 GB | 19 Nov 2005 - 19:10 |
RufusBot Rufus Web Miner | 2275+70 | 205.77 MB | 27 Nov 2005 - 20:04 |
Harvest | 2340 | 31.47 MB | 29 Nov 2005 - 00:03 |
BecomeBot | 2251+59 | 22.34 MB | 30 Nov 2005 - 23:22 |
ZyBorg | 1690+7 | 15.53 MB | 30 Nov 2005 - 23:53 |
Voyager | 1077+12 | 10.36 MB | 30 Nov 2005 - 09:31 |
sohu agent | 875 | 13.71 MB | 28 Nov 2005 - 13:32 |
Cfetch | 691+11 | 5.97 MB | 20 Nov 2005 - 02:06 |
psbot | 634+58 | 3.71 MB | 29 Nov 2005 - 19:07 |
Unknown robot (identified by empty user agent string) | 650+31 | 971.84 MB | 30 Nov 2005 - 20:11 |
ConveraCrawler | 261+2 | 919.05 MB | 30 Nov 2005 - 19:57 |
Turn It In | 201+2 | 28.85 MB | 20 Nov 2005 - 21:57 |
Unknown robot (identified by 'bot*') | 165+38 | 26.32 MB | 28 Nov 2005 - 02:19 |
nicebot | 185 | 3.42 MB | 30 Nov 2005 - 19:48 |
GigaBot | 97+87 | 10.78 MB | 27 Nov 2005 - 05:24 |
Perl tool | 160 | 19.20 MB | 30 Nov 2005 - 18:40 |
NG 2.x (Exalead) | 118+4 | 1.33 MB | 30 Nov 2005 - 01:51 |
ichiro | 107+11 | 1.38 MB | 30 Nov 2005 - 09:01 |
Jakarta commons-httpclient | 67+21 | 7.61 MB | 23 Nov 2005 - 16:55 |
DoCoMo | 77 | 613.76 KB | 14 Nov 2005 - 23:44 |
Combine System | 27+24 | 199.29 KB | 30 Nov 2005 - 21:06 |
Custo | 49 | 31.01 MB | 30 Nov 2005 - 07:30 |
WGet tools | 48+1 | 178.69 MB | 30 Nov 2005 - 19:55 |
Java (Often spam bot) | 43+3 | 9.37 MB | 30 Nov 2005 - 10:51 |
BaiDuSpider | 39+5 | 9.85 MB | 29 Nov 2005 - 19:30 |
SBIder | 22+22 | 149.60 KB | 28 Nov 2005 - 15:53 |
IBM Almaden Research Center WebFountain™ | 27+17 | 3.66 MB | 30 Nov 2005 - 13:15 |
Findlinks | 26+6 | 270.64 KB | 28 Nov 2005 - 04:13 |
sohu-search | 20+10 | 1.69 MB | 28 Nov 2005 - 13:11 |
Argus | 20+10 | 1.46 MB | 27 Nov 2005 - 01:00 |
NutchCVS | 17+12 | 56.84 KB | 30 Nov 2005 - 22:59 |
Alexa (IA Archiver) | 19+9 | 47.17 MB | 30 Nov 2005 - 18:27 |
Walhello appie | 13+14 | 103.92 KB | 30 Nov 2005 - 18:32 |
Unknown robot (identified by 'robot') | 24+3 | 69.50 KB | 29 Nov 2005 - 19:58 |
Unknown robot (identified by 'spider') | 13+13 | 2.77 MB | 30 Nov 2005 - 02:17 |
CFNetwork | 26 | 206.32 MB | 23 Nov 2005 - 08:50 |
Google AdSense | 20+3 | 1015.00 KB | 21 Nov 2005 - 12:47 |
Unknown robot (identified by hit on 'robots.txt') | 0+23 | 1.27 KB | 30 Nov 2005 - 01:07 |
Girafabot | 16+6 | 2.36 MB | 30 Nov 2005 - 21:05 |
lwp-trivial | 18 | 154.99 KB | 30 Nov 2005 - 07:45 |
Voila | 8+9 | 35.59 KB | 29 Nov 2005 - 00:14 |
Yahoo-MMCrawler | 6+9 | 71.85 KB | 30 Nov 2005 - 21:46 |
IlTrovatore-Setaccio | 7+7 | 1.44 KB | 23 Nov 2005 - 11:50 |
Vagabondo | 7+7 | 933.12 KB | 29 Nov 2005 - 22:51 |
Shim-Crawler | 5+5 | 10.85 KB | 13 Nov 2005 - 06:35 |
MJ12bot | 9+1 | 41.70 KB | 29 Nov 2005 - 00:04 |
Unknown robot (identified by 'discovery') | 8 | 0 | 30 Nov 2005 - 19:58 |
Openfind data gatherer | 6+2 | 40.29 KB | 21 Nov 2005 - 06:42 |
Spiderman | 7 | 1.71 MB | 22 Nov 2005 - 07:20 |
UCSD Crawl | 7 | 2.03 MB | 08 Nov 2005 - 15:37 |
Kevin | 6 | 58.85 KB | 17 Nov 2005 - 11:10 |
Geniebot | 3+3 | 15.77 KB | 30 Nov 2005 - 14:52 |
aipbot | 3+3 | 42.83 KB | 30 Nov 2005 - 11:18 |
archive.org bot | 3+3 | 3.56 MB | 30 Nov 2005 - 22:30 |
IRLbot | 5 | 695 Bytes | 17 Nov 2005 - 00:29 |
Powermarks | 5 | 395.95 KB | 25 Nov 2005 - 04:05 |
MSIECrawler | 3+2 | 144 Bytes | 30 Nov 2005 - 08:17 |
Ingrid | 2+2 | 31.44 KB | 17 Nov 2005 - 06:33 |
VSE | 2+2 | 422 Bytes | 12 Nov 2005 - 22:46 |
INFOMINE VLCrawler | 2+2 | 422 Bytes | 23 Nov 2005 - 16:28 |
Unknown robot (identified by 'checker') | 4 | 390.35 KB | 26 Nov 2005 - 11:24 |
larbin | 1+2 | 283 Bytes | 15 Nov 2005 - 00:12 |
UdmSearch | 1+1 | 0 | 26 Nov 2005 - 17:46 |
DNSGroup | 1+1 | 211 Bytes | 01 Nov 2005 - 23:01 |
WebCollage | 2 | 600.66 KB | 30 Nov 2005 - 06:32 |
InfoSeek Robot 1.0 | 1+1 | 9.64 KB | 18 Nov 2005 - 09:51 |
Heritrix | 1+1 | 24.53 KB | 14 Nov 2005 - 11:48 |
Fish search | 2 | 278 Bytes | 13 Nov 2005 - 04:16 |
The web archive (IA Archiver) | 0+2 | 144 Bytes | 29 Nov 2005 - 18:09 |
Gaisbot | 1+1 | 211 Bytes | 19 Nov 2005 - 07:46 |
W3C Link Checker | 1+1 | 72 Bytes | 10 Nov 2005 - 17:31 |
KnowItAll | 1+1 | 5.02 KB | 14 Nov 2005 - 21:38 |
MSRBOT | 1+1 | 8.70 KB | 13 Nov 2005 - 07:10 |
W3C Validator | 1 | 12.05 KB | 21 Nov 2005 - 19:19 |
Asterias | 0+1 | 72 Bytes | 13 Nov 2005 - 04:15 |
Robozilla | 1 | 139 Bytes | 24 Nov 2005 - 18:42 |
HTTrack off-line browser | 1 | 71.85 KB | 16 Nov 2005 - 19:39 |
Python-urllib | 1 | 4.98 MB | 01 Nov 2005 - 20:54 |
Fooky.com/ScorpionBot/ScoutOut | 1 | 139 Bytes | 07 Nov 2005 - 09:53 |
Accoona-AI-Agent | 0+1 | 72 Bytes | 01 Nov 2005 - 01:49 |
Pompos | 0+1 | 72 Bytes | 25 Nov 2005 - 02:51 |
Scooter | 0+1 | 72 Bytes | 01 Nov 2005 - 13:21 |
Exabot | 1 | 0 | 28 Nov 2005 - 22:21 |
Others | 0 | 3.23 KB | |