CaltechTHESIS
  A Caltech Library Service

Safe and Scalable Learning-Based Control: Theory and Application in Sustainable Energy Systems

Citation

Yu, Jing (2025) Safe and Scalable Learning-Based Control: Theory and Application in Sustainable Energy Systems. Dissertation (Ph.D.), California Institute of Technology. doi:10.7907/bgar-0602. https://resolver.caltech.edu/CaltechThesis:08192024-223132153

Abstract

From intelligent transportation systems to the smart grid, the next generation of cyber-physical systems (CPS) will substantially transform our society. It is vital that these systems are scalable and robust to uncertainties, with contextual awareness and fast adaptation. This dissertation presents progress towards addressing key challenges arising in the control of large-scale CPS, with a special focus on applications in sustainable energy systems.

Large-scale CPS such as the smart grid often consist of numerous interconnected and heterogeneous subsystems that must coordinate to achieve global objectives by exchanging information over a communication network. Therefore, the first part of this thesis focuses on developing control algorithms that handle crucial design requirements emerging from scalability and communication constraints, such as disturbance localization, communication delay conformation, and distributed implementation.

Sustainable energy systems are crucial for reducing greenhouse gas emissions and mitigating climate change. However, the inherent unpredictability and large uncertainties associated with renewable generation pose significant challenges for maintaining system stability and safety. Traditional control approaches, while robust and effective for known system models, often fall short when faced with the dynamic and uncertain nature of modern power systems. In the second part of the thesis, we address this challenge by integrating machine learning techniques with model-based control methods using uncertainty sets constructed from real-time data. In particular, we will introduce and provide convergence guarantees for a classic uncertainty set estimation method. Building on these uncertainty sets, we combine learning and control techniques to tackle core CPS control problems, such as adversarial stability certification for linear time-varying systems as well as networked systems under communication constraints where the system models are unknown.

The final part of this thesis applies the developed methodologies to address the voltage control problem in power distribution networks with unknown grid topologies. We will combine online learning techniques and a robust predictive controller to achieve provably finite-time convergence to safe voltage limits, despite uncertainties in network topology and load variations. Our case study on a Southern California Edison 56-bus distribution system demonstrates the effectiveness of this approach in nonlinear, partial observation, and partial control settings.

Item Type:Thesis (Dissertation (Ph.D.))
Subject Keywords:Control Theory, Distributed Control, Online Control, Data-Driven Control, Learning-based Control, Online Learning, Renewable Energy Systems, Model Predictive Control, System Level Synthesis, Large-Scale Systems, Complex Dynamical Systems, Distributed Control, Machine Learning, Learning Theory, Robust Adaptive Control, System Identification
Degree Grantor:California Institute of Technology
Division:Engineering and Applied Science
Major Option:Control and Dynamical Systems
Thesis Availability:Public (worldwide access)
Research Advisor(s):
  • Doyle, John Comstock (co-advisor)
  • Wierman, Adam C. (co-advisor)
Thesis Committee:
  • Low, Steven H. (chair)
  • Doyle, John Comstock
  • Wierman, Adam C.
  • Yue, Yisong
Defense Date:19 July 2024
Funders:
Funding AgencyGrant Number
NSFCNS-2146814
NSFCPS-2136197
NSFCNS-2106403
NSFNGSDI-2105648
NSFECCS-2200692
Amazon AI4Science FellowshipUNSPECIFIED
Resnick Sustainability InstituteUNSPECIFIED
Record Number:CaltechThesis:08192024-223132153
Persistent URL:https://resolver.caltech.edu/CaltechThesis:08192024-223132153
DOI:10.7907/bgar-0602
Related URLs:
URLURL TypeDescription
https://doi.org/10.23919/ACC50511.2021.9483301DOIAdapted for ch. 2: Localized and Distributed H2 State Feedback Control
https://doi.org/10.1109/CDC51059.2022.9992443DOIAdapted for ch. 2: On infinite-horizon system level synthesis problems
https://doi.org/10.23919/ACC45564.2020.9147577DOIAdapted for ch. 3: Achieving performance and safety in large scale systems with saturation using a nonlinear system level synthesis approach
https://openreview.net/forum?id=n2kq2EOHFEPublisherAdapted for ch. 4: Robust reinforcement learning: A constrained game-theoretic approach
https://openreview.net/forum?id=n2kq2EOHFEPublisherAdapted for ch. 4: Learning the Uncertainty Sets of Linear Control Systems via Set Membership: A Non-asymptotic Analysis
https://doi.org/10.1109/CDC49753.2023.1038384DOIAdapted for ch. 5: Online Adversarial Stabilization of Unknown Linear Time-Varying Systems
https://doi.org/10.1145/3579452DOIAdapted for ch. 6: Online adversarial stabilization of unknown networked systems
https://doi.org/10.1145/3538637.3538853DOIAdapted for ch. 7: Robust online voltage control with an unknown grid topology
https://doi.org/10.1109/TSG.2024.3383804DOIAdapted for ch. 7: Online learning for robust voltage control under uncertain grid topology
ORCID:
AuthorORCID
Yu, Jing0000-0003-1318-0189
Default Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:16653
Collection:CaltechTHESIS
Deposited By: Jing Yu
Deposited On:21 Aug 2024 22:04
Last Modified:28 Aug 2024 20:13

Thesis Files

[img] PDF - Final Version
See Usage Policy.

7MB

Repository Staff Only: item control page