360-degree Video Stitching for Dual-fisheye Lens Cameras Based On Rigid Moving Least Squares
This addresses the need for affordable, high-quality 360-degree video capture for user-generated content, representing an incremental improvement in stitching techniques.
The paper tackles the problem of stitching 360-degree videos from dual-fisheye lens cameras, which have limited overlap and cause jitter, by introducing a method using rigid moving least squares for alignment and an algorithm for temporal coherence, resulting in higher quality stitched images and videos than prior work.
Dual-fisheye lens cameras are becoming popular for 360-degree video capture, especially for User-generated content (UGC), since they are affordable and portable. Images generated by the dual-fisheye cameras have limited overlap and hence require non-conventional stitching techniques to produce high-quality 360x180-degree panoramas. This paper introduces a novel method to align these images using interpolation grids based on rigid moving least squares. Furthermore, jitter is the critical issue arising when one applies the image-based stitching algorithms to video. It stems from the unconstrained movement of stitching boundary from one frame to another. Therefore, we also propose a new algorithm to maintain the temporal coherence of stitching boundary to provide jitter-free 360-degree videos. Results show that the method proposed in this paper can produce higher quality stitched images and videos than prior work.