Robust Online Switched Model Identification

In practice, influenced by the changes of external factors, time series data may display abrupt changes in its behaviors, such as stock prices vs regulatory policies, EEG signals vs emotions, human-made systems under malfunctions or battery draining. Given such streaming data, the goal is (i) to learn a model that can characterize its behaviors and (ii) identify the change of behaviors. The challenge comes from solving this in an online fashion.

Adaptive Control for Switched Systems

In this problem, we seek to adaptively control a switched system but with unknown dynamics in a model-based way. That is, the control scheme alternates between estimating system dynamics and designing controllers with the estimated dynamics. We show how the dynamics estimate accuracy and controller optimality improve over time.

System Mode Reduction for Switched Systems

Though switched models are capable of modeling abrupt changes, system complexity issues arise if the number of changes gets large. We utilize clustering techniques to reveal underlying lumped structure and use it to construct reduced models. We show the reduced model have dynamics approximates well the original one. It can also be used as a surrogate to perform analysis or controller design with significant computation cost savings.


  • Du, Zhe, Laura Balzano, and Necmiye Ozay. “A robust algorithm for online switched system identification.” IFAC-PapersOnLine 51.15 (2018): 293-298. [Paper], [Slides]
  • Du, Zhe, Necmiye Ozay, and Laura Balzano. “Mode clustering for markov jump systems.” 2019 IEEE 8th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP). IEEE, 2019. [Paper], [Slides], [Poster]
  • Du, Zhe, Yahya Sattar, Davoud Ataee Tarzanagh, Laura Balzano, Samet Oymak, and Necmiye Ozay. “Certainty Equivalent Quadratic Control for Markov Jump Systems.” arXiv preprint arXiv:2105.12358 (2021). [Paper], [Slides]
  • Du, Zhe, Yahya Sattar, Davoud Ataee Tarzanagh, Laura Balzano, Necmiye Ozay, and Samet Oymak. “Identification and Adaptive Control of Markov Jump Systems: Sample Complexity and Regret Bounds.” ICML Workshop on Reinforcement Learning Theory, 2021. [Paper], [Poster]
  • Du, Zhe, Necmiye Ozay, and Laura Balzano. “Clustering-based Mode Reduction for Markov Jump Systems.” Submitted. [Paper], [Slides]