CVLGMay 8, 2023

Towards Accurate Human Motion Prediction via Iterative Refinement

arXiv:2305.04443v15 citations
Originality Incremental advance
AI Analysis

This work addresses the problem of forecasting human poses for applications in robotics and animation, representing an incremental improvement over existing methods.

The paper tackles human motion prediction by proposing FreqMRN, a framework that iteratively refines predictions using kinematic and temporal features, achieving state-of-the-art performance on benchmarks like Human3.6M, AMASS, and 3DPW with large margins in accuracy and robustness.

Human motion prediction aims to forecast an upcoming pose sequence given a past human motion trajectory. To address the problem, in this work we propose FreqMRN, a human motion prediction framework that takes into account both the kinematic structure of the human body and the temporal smoothness nature of motion. Specifically, FreqMRN first generates a fixed-size motion history summary using a motion attention module, which helps avoid inaccurate motion predictions due to excessively long motion inputs. Then, supervised by the proposed spatial-temporal-aware, velocity-aware and global-smoothness-aware losses, FreqMRN iteratively refines the predicted motion though the proposed motion refinement module, which converts motion representations back and forth between pose space and frequency space. We evaluate FreqMRN on several standard benchmark datasets, including Human3.6M, AMASS and 3DPW. Experimental results demonstrate that FreqMRN outperforms previous methods by large margins for both short-term and long-term predictions, while demonstrating superior robustness.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes