MOMBAT: Heart Rate Monitoring from Face Video using Pulse Modeling and Bayesian Tracking
This work addresses the need for non-invasive, low-cost heart rate monitoring in healthcare and affective computing, offering a significant improvement over existing methods.
The paper tackled the problem of heart rate monitoring from face videos, which is prone to errors from facial movements and environmental noise, by proposing MOMBAT, a method that uses pulse modeling and Bayesian tracking to achieve an average absolute error of 1.329 beats per minute and a Pearson correlation of 0.9746.
A non-invasive yet inexpensive method for heart rate (HR) monitoring is of great importance in many real-world applications including healthcare, psychology understanding, affective computing and biometrics. Face videos are currently utilized for such HR monitoring, but unfortunately this can lead to errors due to the noise introduced by facial expressions, out-of-plane movements, camera parameters (like focus change) and environmental factors. We alleviate these issues by proposing a novel face video based HR monitoring method MOMBAT, that is, MOnitoring using Modeling and BAyesian Tracking. We utilize out-of-plane face movements to define a novel quality estimation mechanism. Subsequently, we introduce a Fourier basis based modeling to reconstruct the cardiovascular pulse signal at the locations containing the poor quality, that is, the locations affected by out-of-plane face movements. Furthermore, we design a Bayesian decision theory based HR tracking mechanism to rectify the spurious HR estimates. Experimental results reveal that our proposed method, MOMBAT outperforms state-of-the-art HR monitoring methods and performs HR monitoring with an average absolute error of 1.329 beats per minute and the Pearson correlation between estimated and actual heart rate is 0.9746. Moreover, it demonstrates that HR monitoring is significantly