Scattering Features for Multimodal Gait Recognition
This work addresses person identification for security or surveillance applications, but it is incremental as it builds on existing multimodal sensor approaches.
The paper tackled gait recognition by using acoustic and vibration sensors, proposing a shallow scattering network for feature extraction and showing that fusing these modalities improves identification in open-set scenarios.
We consider the problem of identifying people on the basis of their walk (gait) pattern. Classical approaches to tackle this problem are based on, e.g., video recordings or piezoelectric sensors embedded in the floor. In this work, we rely on acoustic and vibration measurements, obtained from a microphone and a geophone sensor, respectively. The contribution of this work is twofold. First, we propose a feature extraction method based on an (untrained) shallow scattering network, specially tailored for the gait signals. Second, we demonstrate that fusing the two modalities improves identification in the practically relevant open set scenario.