Control and State-Estimation of Jump Stochastic Systems by Learning Recurrent Spatiotemporal Patterns

Citation

Han, SooJean (2023) Control and State-Estimation of Jump Stochastic Systems by Learning Recurrent Spatiotemporal Patterns. Dissertation (Ph.D.), California Institute of Technology. doi:10.7907/gyae-jv94. https://resolver.caltech.edu/CaltechTHESIS:01302023-023806052

Abstract

This thesis establishes control and estimation architectures that combine both model-based and model-free methods by theoretically characterizing several types of jump stochastic systems (JSSs), i.e., systems with random and repetitive jump phenomena. By expanding the capabilities of model-based stochastic control and estimation, there is potential for artificial intelligence to be implemented as a supplement to theory-influenced design instead of being used end-to-end. We begin by deriving sufficient conditions for stochastic incremental stability for nonlinear systems perturbed by two types of non-Gaussian noise: 1) shot noise processes represented as compound Poisson processes, and 2) finite-measure Lévy processes constructed as affine combinations of Gaussian white and Poisson shot noise processes. We then present a controller architecture based on a concept we call pattern-learning for prediction (PLP) for discrete-time/discrete-event systems, in which we can take advantage of the fact that the underlying jump process is a sequence of random variables that occurs as repeated patterns of interest. Finally, we demonstrate control and estimation for JSSs in three real-world applications. First, we consider the control of networks with dynamic topology (e.g., power grid with fault-tolerance to downed lines), for which PLP is integrated with variations of the novel system-level synthesis framework for disturbance-rejection. Second, we perform congestion control of vehicle traffic flow over metropolitan intersection networks, for which PLP is extended to pattern-learning with memory and prediction (PLMP) via the inclusion of episodic control, designed to reduce memory consumption by exploiting structural symmetries and temporal repetition in the network. Third, we perform estimation and forecasting (the dual problem to control) for epidemic spread throughout a population network under jump phenomena such as superspreader effects and the emergence of variant viruses. Our results indicate that learning patterns in the jump process makes controller/observer design efficient in data-consumption and computation time, which suggests that it can potentially be used for other JSSs in the real world.

Thesis Files