CoreUI: Interactive Core Training System with 3D Human Shape
This addresses the need for affordable and interactive core training tools for users, though it is incremental as it builds on existing pose estimation and mesh recovery methods.
The paper tackles the problem of expensive human pose capture for core training by developing an interactive system that recovers 3D human shape from monocular camera images, using visual guidance with markers to show differences from target poses. The system was found effective and convenient in user studies compared to conventional 2D skeleton guidance.
We present an interactive core training system for core training using a monocular camera image as input in this paper. It is commonly expensive to capture human pose using depth cameras or multiple cameras with conventional approaches. To solve this issue, we employ the skinned multi-person linear model of human shape to recover the 3D human pose from 2D images using pose estimation and human mesh recovery approaches. In order to support the user in maintaining the correct postures from target poses in the training, we adopt 3D human shape estimation for both the target image and input camera video. We propose CoreUI, a user interface for providing visual guidance showing the differences among the estimated targets and current human shapes in core training, which are visualized by markers at ten body parts with color changes. From our user studies, the proposed core training system is effective and convenient compared with the conventional guidance of 2D skeletons.