A Caltech Library Service

Classification and Approximation with Rule-Based Networks


Higgins, Charles Marion (1993) Classification and Approximation with Rule-Based Networks. Dissertation (Ph.D.), California Institute of Technology. doi:10.7907/4r7r-w573.


This thesis describes the architecture of learning systems which can explain their decisions through a rule-based knowledge representation. Two problems in learning are addressed: pattern classification and function approximation.

In Part I, a pattern classifier for discrete-valued problems is presented. The system utilizes an information-theoretic algorithm for constructing informative rules from example data. These rules are then used to construct a computational network to perform parallel inference and posterior probability estimation. The network can be extended incrementally; that is, new data can be incorporated without repeating the training on previous data. It is shown that this technique performs comparably with other techniques including the backpropagation network while having unique advantages in incremental learning capability, training efficiency, and knowledge representation. Examples are shown of rule-based classification and explanation.

In Part II, we present a method for the learning of fuzzy logic membership functions and rules to predict a numerical function from examples of the function and its independent variables. This method uses a three-step approach to building a complete function approximation system: first, learning the membership functions and creating a cell-based rule representation; second, simplifying the cell-based rules using an information-theoretic approach for induction of rules from discrete-valued data; and finally, constructing a computational network to compute the function value given its independent variables. Applications of the system to adaptive control are suggested, including a method for learning a complete control system for an unknown plant. Experimental validation of the suggested methods using a ball-and-beam system is shown.

Item Type:Thesis (Dissertation (Ph.D.))
Subject Keywords:(Electrical Engineering)
Degree Grantor:California Institute of Technology
Division:Engineering and Applied Science
Major Option:Electrical Engineering
Thesis Availability:Public (worldwide access)
Research Advisor(s):
  • Goodman, Rodney M.
Thesis Committee:
  • Goodman, Rodney M. (chair)
  • Murray, Richard M.
  • Abu-Mostafa, Yaser S.
  • Franklin, Joel N.
  • Posner, Edward C.
Defense Date:12 May 1993
Record Number:CaltechETD:etd-08272007-132407
Persistent URL:
Default Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:3245
Deposited By: Imported from ETD-db
Deposited On:06 Sep 2007
Last Modified:30 Aug 2022 20:07

Thesis Files

PDF - Final Version
See Usage Policy.


Repository Staff Only: item control page