Smooth head tracking for virtual reality applications
This addresses the problem of smooth and marker-free head tracking for VR users, though it appears incremental as it builds on existing tracking and interpolation techniques.
The paper tackles head tracking for virtual reality by proposing a method that uses RGBD data and facial features to compute head pose, then predicts and interpolates smooth trajectories for camera movement, resulting in a continuous, ergonomic, and jerk-free motion model.
In this work, we propose a new head-tracking solution for human-machine real-time interaction with virtual 3D environments. This solution leverages RGBD data to compute virtual camera pose according to the movements of the user's head. The process starts with the extraction of a set of facial features from the images delivered by the sensor. Such features are matched against their respective counterparts in a reference image for the computation of the current head pose. Afterwards, a prediction approach is used to guess the most likely next head move (final pose). Pythagorean Hodograph interpolation is then adapted to determine the path and local frames taken between the two poses. The result is a smooth head trajectory that serves as an input to set the camera in virtual scenes according to the user's gaze. The resulting motion model has the advantage of being: continuous in time, it adapts to any frame rate of rendering; it is ergonomic, as it frees the user from wearing tracking markers; it is smooth and free from rendering jerks; and it is also torsion and curvature minimizing as it produces a path with minimum bending energy.