Learning System Dynamics without Forgetting
This addresses a largely overlooked challenge in fields like physics and biology, enabling trajectory prediction for systems with unknown and evolving dynamics, though it appears incremental as it builds on existing techniques.
The paper tackles the problem of learning across systems with evolving dynamics patterns, proposing the MS-GODE model and introducing the Bio-CDL benchmark, achieving efficient learning over varying dynamics.
Observation-based trajectory prediction for systems with unknown dynamics is essential in fields such as physics and biology. Most existing approaches are limited to learning within a single system with fixed dynamics patterns. However, many real-world applications require learning across systems with evolving dynamics patterns, a challenge that has been largely overlooked. To address this, we systematically investigate the problem of Continual Dynamics Learning (CDL), examining task configurations and evaluating the applicability of existing techniques, while identifying key challenges. In response, we propose the Mode-switching Graph ODE (MS-GODE) model, which integrates the strengths LG-ODE and sub-network learning with a mode-switching module, enabling efficient learning over varying dynamics. Moreover, we construct a novel benchmark of biological dynamic systems for CDL, Bio-CDL, featuring diverse systems with disparate dynamics and significantly enriching the research field of machine learning for dynamic systems. Our code available at https://github.com/QueuQ/MS-GODE.