Error Bounds of Projection Models in Weakly Supervised 3D Human Pose Estimation
This work addresses the inherent error limitations in projection models for 3D human pose estimation, which is incremental as it provides theoretical bounds rather than a new method.
The paper analyzes simplified projection models in weakly supervised 3D human pose estimation, deriving theoretical lower bound errors of 19.3mm to 54.7mm for normalized and weak perspective projections, and shows how to replace normalized perspective to avoid this minimal error.
The current state-of-the-art in monocular 3D human pose estimation is heavily influenced by weakly supervised methods. These allow 2D labels to be used to learn effective 3D human pose recovery either directly from images or via 2D-to-3D pose uplifting. In this paper we present a detailed analysis of the most commonly used simplified projection models, which relate the estimated 3D pose representation to 2D labels: normalized perspective and weak perspective projections. Specifically, we derive theoretical lower bound errors for those projection models under the commonly used mean per-joint position error (MPJPE). Additionally, we show how the normalized perspective projection can be replaced to avoid this guaranteed minimal error. We evaluate the derived lower bounds on the most commonly used 3D human pose estimation benchmark datasets. Our results show that both projection models lead to an inherent minimal error between 19.3mm and 54.7mm, even after alignment in position and scale. This is a considerable share when comparing with recent state-of-the-art results. Our paper thus establishes a theoretical baseline that shows the importance of suitable projection models in weakly supervised 3D human pose estimation.