MPEG Media Enablers For Richer XR Experiences
This work aims to lower barriers for XR application development, making immersive experiences more accessible to developers and designers, though it appears incremental as part of broader MPEG-I standards.
The paper tackles the challenge of high-quality XR streaming by introducing MPEG-I parts 13 and 14, which address decoder management and scene composition to simplify media rendering and hardware management for developers.
With the advent of immersive media applications, the requirements for the representation and the consumption of such content has dramatically increased. The ever-increasing size of the media asset combined with the stringent motion-to-photon latency requirement makes the equation of a high quality of experience for XR streaming services difficult to solve. The MPEG-I standards aim at facilitating the wide deployment of immersive applications. This paper describes part 13, Video Decoding Interface, and part 14, Scene Description for MPEG Media of MPEG-I which address decoder management and the virtual scene composition, respectively. These new parts intend to make complex media rendering operations and hardware resources management hidden from the application, hence lowering the barrier for XR application to become mainstream and accessible to XR experience developers and designers. Both parts are expected to be published by ISO at the end of 2021.