CVNov 21, 2022

PLIKS: A Pseudo-Linear Inverse Kinematic Solver for 3D Human Body Estimation

arXiv:2211.11734v236 citationsh-index: 26
Originality Incremental advance
AI Analysis

This addresses the problem of accurate and flexible 3D human body reconstruction for computer vision applications, offering an incremental improvement over existing methods.

The paper tackles 3D human body estimation from single 2D images by introducing PLIKS, a pseudo-linear inverse kinematic solver that reformulates the SMPL model linearly, achieving over 10% improvement in accuracy on standard benchmarks and a 12.9 mm reduction in reconstruction error on the AGORA dataset.

We introduce PLIKS (Pseudo-Linear Inverse Kinematic Solver) for reconstruction of a 3D mesh of the human body from a single 2D image. Current techniques directly regress the shape, pose, and translation of a parametric model from an input image through a non-linear mapping with minimal flexibility to any external influences. We approach the task as a model-in-the-loop optimization problem. PLIKS is built on a linearized formulation of the parametric SMPL model. Using PLIKS, we can analytically reconstruct the human model via 2D pixel-aligned vertices. This enables us with the flexibility to use accurate camera calibration information when available. PLIKS offers an easy way to introduce additional constraints such as shape and translation. We present quantitative evaluations which confirm that PLIKS achieves more accurate reconstruction with greater than 10% improvement compared to other state-of-the-art methods with respect to the standard 3D human pose and shape benchmarks while also obtaining a reconstruction error improvement of 12.9 mm on the newer AGORA dataset.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes