Distilling Governing Laws and Source Input for Dynamical Systems from Videos
This addresses a gap in computer vision where no existing methods could extract explicit governing equations and source inputs from video data of dynamical systems.
The paper tackles the problem of automatically discovering interpretable physical laws from videos of dynamical systems, introducing an unsupervised deep learning framework that successfully distills closed-form governing equations and identifies unknown excitation inputs from simulated video recordings.
Distilling interpretable physical laws from videos has led to expanded interest in the computer vision community recently thanks to the advances in deep learning, but still remains a great challenge. This paper introduces an end-to-end unsupervised deep learning framework to uncover the explicit governing equations of dynamics presented by moving object(s), based on recorded videos. Instead in the pixel (spatial) coordinate system of image space, the physical law is modeled in a regressed underlying physical coordinate system where the physical states follow potential explicit governing equations. A numerical integrator-based sparse regression module is designed and serves as a physical constraint to the autoencoder and coordinate system regression, and, in the meanwhile, uncover the parsimonious closed-form governing equations from the learned physical states. Experiments on simulated dynamical scenes show that the proposed method is able to distill closed-form governing equations and simultaneously identify unknown excitation input for several dynamical systems recorded by videos, which fills in the gap in literature where no existing methods are available and applicable for solving this type of problem.