Huazhen Fang

Huazhen Fang, Ning Tian, Yebin Wang et al.

This article presents an up-to-date tutorial review of nonlinear Bayesian estimation. State estimation for nonlinear systems has been a challenge encountered in a wide range of engineering fields, attracting decades of research effort. To date, one of the most promising and popular approaches is to view and address the problem from a Bayesian probabilistic perspective, which enables estimation of the unknown state variables by tracking their probabilistic distribution or statistics (e.g., mean and covariance) conditioned on the system's measurement data. This article offers a systematic introduction of the Bayesian state estimation framework and reviews various Kalman filtering (KF) techniques, progressively from the standard KF for linear systems to extended KF, unscented KF and ensemble KF for nonlinear systems. It also overviews other prominent or emerging Bayesian estimation methods including the Gaussian filtering, Gaussian-sum filtering, particle filtering and moving horizon estimation and extends the discussion of state estimation forward to more complicated problems such as simultaneous state and parameter/input estimation.

Hao Tu, Jackson Fogelquist, Iman Askari et al.

This paper studies system identification for nonlinear state-space models, a problem that arises across many fields yet remains challenging in practice. Focusing on maximum likelihood estimation, we employ Bayesian optimization (BayesOpt) to address this problem by leveraging its derivative-free global search capability enabled by surrogate modeling of the likelihood function. Despite these advantages, standard BayesOpt often suffers from slow convergence, high computational cost, and practical difficulty in attaining global optima under limited computational budgets, especially for high-dimensional nonlinear models with many unknown parameters. To overcome these limitations, we propose an accelerated BayesOpt framework that integrates BayesOpt with the Nelder--Mead method. Heuristics-based, the Nelder--Mead method provides fast local search, thereby assisting BayesOpt when the surrogate model lacks fidelity or when over-exploration occurs in broad parameter spaces. The proposed framework incorporates a principled strategy to coordinate the two methods, effectively combining their complementary strengths. The resulting hybrid approach significantly improves both convergence speed and computational efficiency while maintaining strong global search performance. In addition, we leverage an implicit particle filtering method to enable accurate and efficient likelihood evaluation. We validate the proposed framework on the identification of the BattX model for lithium-ion batteries, which features ten state dimensions, 18 unknown parameters, and strong nonlinearity. Both simulation and experimental results demonstrate the effectiveness of the proposed approach as well as its advantages over alternative methods.

Farzaneh Barat, Sara Wilson, Huijeong Kim et al.

System identification remains an intriguing challenge for lithium-ion batteries, as many models are nonlinear, exhibit multi-physics coupling, and involve a large number of parameters. In this paper, we address this challenge using the ensemble Kalman inversion (EnKI) method for battery system identification. EnKI performs maximum a posteriori parameter estimation through successive local Gaussian approximations, enabling an iterative and incremental search for unknown parameters. The search combines Monte Carlo sampling with Kalman-type updates to evolve an ensemble of samples, thereby offering empirical stability and the ability to handle strongly nonlinear models. We validate the proposed approach on two equivalent circuit models with coupled electro-thermal dynamics, through both simulation and experiments. The results demonstrate that the proposed approach achieves accurate parameter estimation with rapid iterative convergence, and it shows strong potential for application to other battery models.

Tao Zhe, Huazhen Fang, Kunpeng Liu et al.

Feature transformation enhances downstream task performance by generating informative features through mathematical feature crossing. Despite the advancements in deep learning, feature transformation remains essential for structured data, where deep models often struggle to capture complex feature interactions. Prior literature on automated feature transformation has achieved success but often relies on heuristics or exhaustive searches, leading to inefficient and time-consuming processes. Recent works employ reinforcement learning (RL) to enhance traditional approaches through a more effective trial-and-error way. However, two limitations remain: 1) Dynamic feature expansion during the transformation process, which causes instability and increases the learning complexity for RL agents; 2) Insufficient cooperation and communication between agents, which results in suboptimal feature crossing operations and degraded model performance. To address them, we propose a novel heterogeneous multi-agent RL framework to enable cooperative and scalable feature transformation. The framework comprises three heterogeneous agents, grouped into two types, each designed to select essential features and operations for feature crossing. To enhance communication among these agents, we implement a shared critic mechanism that facilitates information exchange during feature transformation. To handle the dynamically expanding feature space, we tailor multi-head attention-based feature agents to select suitable features for feature crossing. Additionally, we introduce a state encoding technique during the optimization process to stabilize and enhance the learning dynamics of the RL agents, resulting in more robust and reliable transformation policies. Finally, we conduct extensive experiments to validate the effectiveness, efficiency, robustness, and interpretability of our model.

Hao Tu, Scott Moura, Yebin Wang et al.

Mathematical modeling of lithium-ion batteries (LiBs) is a primary challenge in advanced battery management. This paper proposes two new frameworks to integrate physics-based models with machine learning to achieve high-precision modeling for LiBs. The frameworks are characterized by informing the machine learning model of the state information of the physical model, enabling a deep integration between physics and machine learning. Based on the frameworks, a series of hybrid models are constructed, through combining an electrochemical model and an equivalent circuit model, respectively, with a feedforward neural network. The hybrid models are relatively parsimonious in structure and can provide considerable voltage predictive accuracy under a broad range of C-rates, as shown by extensive simulations and experiments. The study further expands to conduct aging-aware hybrid modeling, leading to the design of a hybrid model conscious of the state-of-health to make prediction. The experiments show that the model has high voltage predictive accuracy throughout a LiB's cycle life.

Hao Tu, Scott Moura, Huazhen Fang

Mathematical modeling of lithium-ion batteries (LiBs) is a central challenge in advanced battery management. This paper presents a new approach to integrate a physics-based model with machine learning to achieve high-precision modeling for LiBs. This approach uniquely proposes to inform the machine learning model of the dynamic state of the physical model, enabling a deep integration between physics and machine learning. We propose two hybrid physics-machine learning models based on the approach, which blend a single particle model with thermal dynamics (SPMT) with a feedforward neural network (FNN) to perform physics-informed learning of a LiB's dynamic behavior. The proposed models are relatively parsimonious in structure and can provide considerable predictive accuracy even at high C-rates, as shown by extensive simulations.

Chuan Yan, Huazhen Fang

This paper studies robust tracking control for a leader-follower multi-agent system (MAS) subject to disturbances. A challenging problem is considered here, which differs from those in the literature in two aspects. First, we consider the case when all the leader and follower agents are affected by disturbances, while the existing studies assume only the followers to suffer disturbances. Second, we assume the disturbances to be bounded only in rates of change rather than magnitude as in the literature. To address this new problem, we propose a novel observer-based distributed tracking control design. As a distinguishing feature, the followers can cooperatively estimate the disturbance affecting the leader to adjust their maneuvers accordingly, which is enabled by the design of the first-of-its-kind distributed disturbance observers. We build specific tracking control approaches for both first- and second-order MASs and prove that they can lead to bounded-error tracking, despite the challenges due to the relaxed assumptions about disturbances. We further perform simulation to validate the proposed approaches.

Huazhen Fang, Mulugeta A. Haile, Yebin Wang

Outliers can contaminate the measurement process of many nonlinear systems, which can be caused by sensor errors, model uncertainties, change in ambient environment, data loss or malicious cyber attacks. When the extended Kalman filter (EKF) is applied to such systems for state estimation, the outliers can seriously reduce the estimation accuracy. This paper proposes an innovation saturation mechanism to modify the EKF toward building robustness against outliers. This mechanism applies a saturation function to the innovation process that the EKF leverages to correct the state estimation. As such, when an outlier occurs, the distorting innovation is saturated and thus prevented from damaging the state estimation. The mechanism features an adaptive adjustment of the saturation bound. The design leads to the development robust EKF approaches for continuous- and discrete-time systems. They are proven to be capable of generating bounded-error estimation in the presence of bounded outlier disturbances. An application study about mobile robot localization is presented, with the numerical simulation showing the efficacy of the proposed design. Compared to existing methods, the proposed approaches can effectively reject outliers of various magnitudes, types and durations, at significant computational efficiency and without requiring measurement redundancy.

Chuan Yan, Huazhen Fang

Leader-follower tracking control design has received significant attention in recent years due to its important and wide applications. Considering a multi-agent system composed of a leader and multiple followers, this paper proposes and investigates a new perspective into this problem: can we enable a follower to estimate the leader's driving input and leverage this idea to develop new observer-based tracking control approaches? With this motivation, we develop an input-observer-based leader-follower tracking control framework, which features distributed input observers that allow a follower to locally estimate the leader's input toward enhancing tracking control. This work first studies the first-order tracking problem. It then extends to the more sophisticated case of second-order tracking and considers a challenging situation when the leader's and followers' velocities are not measured. The proposed approaches exhibit interesting and useful advantages as revealed by a comparison with the literature. Convergence properties of the proposed approaches are rigorously analyzed. Simulation results further illustrate the efficacy of the proposed perspective, framework and approaches.