CaltechTHESIS
  A Caltech Library Service

The Scheduling Problem in Learning from Hints

Citation

Çataltepe, Zehra Kök (1994) The Scheduling Problem in Learning from Hints. Master's thesis, California Institute of Technology. doi:10.7907/3zvq-w228. https://resolver.caltech.edu/CaltechTHESIS:03272012-100501462

Abstract

Any information about the function to be learned is called a hint. Learning from hints is a generalization of learning from examples. In this paradigm, hints are expressed by their examples and then taught to a learning-from-examples system. In general, using other hints in addition to the examples of the function, improves the generalization performance.

The scheduling problem in learning from hints is deciding which hint to teach at which time during training. Over- or under- emphasizing a hint may render it useless, making scheduling very important. Fixed and adaptive schedules are two types of schedules that are discussed.

Adaptive minimization is a general adaptive schedule that uses an estimate of generalization error in terms of errors on hints. when such an estimate is available, it can also be optimized by means of directly descending on it. An estimate may be used to decide on when to stop training, too.

A method to find a estimate incorporating the errors on invariance hints, and simulation results on this estimate, are presented. Two computer programs that provide a learning-from-hints environment and improvements on them are discussed.

Item Type:Thesis (Master's thesis)
Subject Keywords:Computer Science
Degree Grantor:California Institute of Technology
Division:Engineering and Applied Science
Major Option:Computer Science
Thesis Availability:Public (worldwide access)
Research Advisor(s):
  • Abu-Mostafa, Yaser S.
Thesis Committee:
  • Unknown, Unknown
Defense Date:26 May 1994
Non-Caltech Author Email:cataltepe (AT) itu.edu.tr
Other Numbering System:
Other Numbering System NameOther Numbering System ID
Computer Science Technical Report94-09
Record Number:CaltechTHESIS:03272012-100501462
Persistent URL:https://resolver.caltech.edu/CaltechTHESIS:03272012-100501462
DOI:10.7907/3zvq-w228
Related URLs:
URLURL TypeDescription
http://resolver.caltech.edu/CaltechCSTR:1994.cs-tr-94-09Related DocumentComputer Science Technical Report 94-09 in CaltechAUTHORS
ORCID:
AuthorORCID
Çataltepe, Zehra Kök0000-0002-9742-5907
Default Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:6874
Collection:CaltechTHESIS
Deposited By: Benjamin Perez
Deposited On:27 Mar 2012 17:55
Last Modified:09 Nov 2022 19:20

Thesis Files

[img]
Preview
PDF - Final Version
See Usage Policy.

2MB

Repository Staff Only: item control page