Shape Distributions of Nonlinear Dynamical Systems for Video-based Inference
This work addresses video-based inference tasks such as activity recognition and rehabilitation monitoring, offering a novel feature representation that is stable with limited data, though it appears incremental as it builds on existing dynamical systems analysis.
The paper tackles the problem of analyzing nonlinear dynamical systems in video-based inference by proposing a shape-theoretic framework that uses descriptors of the dynamical attractor's shape as features, showing stability across different time-series lengths and validating it on tasks like activity recognition and stroke rehabilitation assessment.
This paper presents a shape-theoretic framework for dynamical analysis of nonlinear dynamical systems which appear frequently in several video-based inference tasks. Traditional approaches to dynamical modeling have included linear and nonlinear methods with their respective drawbacks. A novel approach we propose is the use of descriptors of the shape of the dynamical attractor as a feature representation of nature of dynamics. The proposed framework has two main advantages over traditional approaches: a) representation of the dynamical system is derived directly from the observational data, without any inherent assumptions, and b) the proposed features show stability under different time-series lengths where traditional dynamical invariants fail. We illustrate our idea using nonlinear dynamical models such as Lorenz and Rossler systems, where our feature representations (shape distribution) support our hypothesis that the local shape of the reconstructed phase space can be used as a discriminative feature. Our experimental analyses on these models also indicate that the proposed framework show stability for different time-series lengths, which is useful when the available number of samples are small/variable. The specific applications of interest in this paper are: 1) activity recognition using motion capture and RGBD sensors, 2) activity quality assessment for applications in stroke rehabilitation, and 3) dynamical scene classification. We provide experimental validation through action and gesture recognition experiments on motion capture and Kinect datasets. In all these scenarios, we show experimental evidence of the favorable properties of the proposed representation.