A Caltech Library Service

Robustness, Adaptation, and Learning in Optimal Control


Papusha, Ivan Igorevych (2016) Robustness, Adaptation, and Learning in Optimal Control. Dissertation (Ph.D.), California Institute of Technology. doi:10.7907/Z9F18WPB.


Recent technological advances have opened the door to a wide variety of dynamic control applications, which are enabled by increasing computational power in ever smaller devices. These advances are backed by reliable optimization algorithms that allow specification, synthesis, and embedded implementation of sophisticated learning-based controllers. However, as control systems become more pervasive, dynamic, and complex, the control algorithms governing them become more complex to design and analyze. In many cases, optimal control policies are practically impossible to determine unless the state dimension is small, or the dynamics are simple. Thus, in order to make implementation progress, the control designer must specialize to suboptimal architectures and approximate control. The major engineering challenge in the upcoming decades will be how to cope with the complexity of designing implementable control architectures for these smart systems while certifying their safety, robustness, and performance.

This thesis tackles the design and verification complexity by carefully employing tractable lower and upper bounds on the Lyapunov function, while making connections to robust control, formal synthesis, and machine learning. Specifically, optimization-based upper bounds are used to specify robust controllers, while lower bounds are used to obtain performance bounds and to synthesize approximately optimal policies. Implementation of these bounds depends critically on carrying out learning and optimization in the loop. Examples in aerospace, formal methods, hybrid systems, and networked adaptive systems are given, and novel sources of identifiability and persistence of excitation are discussed.

Item Type:Thesis (Dissertation (Ph.D.))
Subject Keywords:convex optimization; robust control; adaptive control; system identification; dynamic programming; formal methods; hybrid systems; networked systems
Degree Grantor:California Institute of Technology
Division:Engineering and Applied Science
Major Option:Control and Dynamical Systems
Thesis Availability:Public (worldwide access)
Research Advisor(s):
  • Murray, Richard M.
Thesis Committee:
  • Murray, Richard M. (chair)
  • Doyle, John Comstock
  • Burdick, Joel Wakeman
  • Lavretsky, Eugene
Defense Date:12 May 2016
Funding AgencyGrant Number
National Defense Science and Engineering Graduate FellowshipUNSPECIFIED
Record Number:CaltechTHESIS:06032016-102336160
Persistent URL:
Default Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:9831
Deposited By: Ivan Papusha
Deposited On:06 Jun 2016 20:19
Last Modified:07 Dec 2020 22:58

Thesis Files

PDF - Final Version
See Usage Policy.


Repository Staff Only: item control page