MobileCodec: Neural Inter-frame Video Compression on Mobile Devices
This enables practical neural video compression for mobile users, though it is incremental as it builds on existing neural codec simulations.
The paper tackled the challenge of running neural video codecs on mobile devices by demonstrating the first inter-frame neural video decoder on a commercial phone, achieving real-time decoding of high-definition videos with low bitrate and high visual quality.
Realizing the potential of neural video codecs on mobile devices is a big technological challenge due to the computational complexity of deep networks and the power-constrained mobile hardware. We demonstrate practical feasibility by leveraging Qualcomm's technology and innovation, bridging the gap from neural network-based codec simulations running on wall-powered workstations, to real-time operation on a mobile device powered by Snapdragon technology. We show the first-ever inter-frame neural video decoder running on a commercial mobile phone, decoding high-definition videos in real-time while maintaining a low bitrate and high visual quality.