Placing Human Animations into 3D Scenes by Learning Interaction- and Geometry-Driven Keyframes
This addresses the challenge of realistic human-scene interaction in computer graphics and animation, offering an incremental improvement over existing methods.
The paper tackles the problem of placing 3D human animations into 3D scenes while preserving interactions like standing or sitting, by introducing a method called PAAK that uses keyframes to optimize placement. It shows that human raters preferred PAAK over PROX ground truth 64.6% of the time and over POSA 61.5% of the time.
We present a novel method for placing a 3D human animation into a 3D scene while maintaining any human-scene interactions in the animation. We use the notion of computing the most important meshes in the animation for the interaction with the scene, which we call "keyframes." These keyframes allow us to better optimize the placement of the animation into the scene such that interactions in the animations (standing, laying, sitting, etc.) match the affordances of the scene (e.g., standing on the floor or laying in a bed). We compare our method, which we call PAAK, with prior approaches, including POSA, PROX ground truth, and a motion synthesis method, and highlight the benefits of our method with a perceptual study. Human raters preferred our PAAK method over the PROX ground truth data 64.6\% of the time. Additionally, in direct comparisons, the raters preferred PAAK over competing methods including 61.5\% compared to POSA.