Subgradient Method for System Identification with Non-Smooth Objectives
It addresses robust system identification for safety-critical applications, but is incremental as it builds on existing theoretical work by focusing on practical algorithm design.
This paper tackles the system identification problem for linear time-invariant systems with non-smooth objectives by analyzing a subgradient-based algorithm, establishing linear convergence to the ground-truth system after a burn-in period and comparing time complexity with standard solvers.
This paper investigates a subgradient-based algorithm to solve the system identification problem for linear time-invariant systems with non-smooth objectives. This is essential for robust system identification in safety-critical applications. While existing work provides theoretical exact recovery guarantees using optimization solvers, the design of fast learning algorithms with convergence guarantees for practical use remains unexplored. We analyze the subgradient method in this setting, where the optimization problems to be solved evolve over time as new measurements are collected, and we establish linear convergence to the ground-truth system for both the best and Polyak step sizes after a burn-in period. We further characterize sublinear convergence of the iterates under constant and diminishing step sizes, which require only minimal information and thus offer broad applicability. Finally, we compare the time complexity of standard solvers with the subgradient algorithm and support our findings with experimental results. This is the first work to analyze subgradient algorithms for system identification with non-smooth objectives.