Nonlinear Dynamical Systems for Automatic Face Annotation in Head Tracking and Pose Estimation
This provides practical guidance for selecting filters in facial tracking applications like motion capture and facial recognition, but it is incremental as it compares existing methods.
They compared Extended Kalman Filter (EKF) and Unscented Kalman Filter (UKF) for 3D facial tracking, finding UKF has lower mean squared error in noise-free settings but EKF is more robust with stochastic noise.
Facial landmark tracking plays a vital role in applications such as facial recognition, expression analysis, and medical diagnostics. In this paper, we consider the performance of the Extended Kalman Filter (EKF) and Unscented Kalman Filter (UKF) in tracking 3D facial motion in both deterministic and stochastic settings. We first analyze a noise-free environment where the state transition is purely deterministic, demonstrating that UKF outperforms EKF by achieving lower mean squared error (MSE) due to its ability to capture higher-order nonlinearities. However, when stochastic noise is introduced, EKF exhibits superior robustness, maintaining lower mean square error (MSE) compared to UKF, which becomes more sensitive to measurement noise and occlusions. Our results highlight that UKF is preferable for high-precision applications in controlled environments, whereas EKF is better suited for real-world scenarios with unpredictable noise. These findings provide practical insights for selecting the appropriate filtering technique in 3D facial tracking applications, such as motion capture and facial recognition.