Inter-View Depth Consistency Testing in Depth Difference Subspace
This work addresses the issue of depth inconsistency for free-viewpoint television users, but it is incremental as it builds on existing stereo-matching and view synthesis techniques.
The paper tackles the problem of inconsistent depth images across multiple viewpoints in free-viewpoint television, which negatively affects view synthesis quality, by proposing a method for depth consistency testing in a depth difference subspace and a consistency-adaptive view synthesis algorithm, resulting in an improvement of up to 1.4 dB in objective quality for virtual views.
Multiview depth imagery will play a critical role in free-viewpoint television. This technology requires high quality virtual view synthesis to enable viewers to move freely in a dynamic real world scene. Depth imagery at different viewpoints is used to synthesize an arbitrary number of novel views. Usually, depth images at multiple viewpoints are estimated individually by stereo-matching algorithms, and hence, show lack of interview consistency. This inconsistency affects the quality of view synthesis negatively. This paper proposes a method for depth consistency testing in depth difference subspace to enhance the depth representation of a scene across multiple viewpoints. Furthermore, we propose a view synthesis algorithm that uses the obtained consistency information to improve the visual quality of virtual views at arbitrary viewpoints. Our method helps us to find a linear subspace for our depth difference measurements in which we can test the inter-view consistency efficiently. With this, our approach is able to enhance the depth information for real world scenes. In combination with our consistency-adaptive view synthesis, we improve the visual experience of the free-viewpoint user. The experiments show that our approach enhances the objective quality of virtual views by up to 1.4 dB. The advantage for the subjective quality is also demonstrated.