MVAnimate: Enhancing Character Animation with Multi-View Optimization
This addresses the need for realistic character animation in various domains, but appears incremental as it builds on multi-view optimization techniques.
The paper tackles the problem of low-quality and data-deficient character animation by introducing MVAnimate, a framework that synthesizes 2D and 3D information using multi-view optimization to enhance video quality, demonstrating improvements over existing methods.
The demand for realistic and versatile character animation has surged, driven by its wide-ranging applications in various domains. However, the animation generation algorithms modeling human pose with 2D or 3D structures all face various problems, including low-quality output content and training data deficiency, preventing the related algorithms from generating high-quality animation videos. Therefore, we introduce MVAnimate, a novel framework that synthesizes both 2D and 3D information of dynamic figures based on multi-view prior information, to enhance the generated video quality. Our approach leverages multi-view prior information to produce temporally consistent and spatially coherent animation outputs, demonstrating improvements over existing animation methods. Our MVAnimate also optimizes the multi-view videos of the target character, enhancing the video quality from different views. Experimental results on diverse datasets highlight the robustness of our method in handling various motion patterns and appearances.