CVDec 4, 2024

Style3D: Attention-guided Multi-view Style Transfer for 3D Object Generation

arXiv:2412.03571v16 citationsh-index: 9
Originality Incremental advance
AI Analysis

This provides a more flexible and scalable solution for creating style-consistent 3D assets, which is incremental as it builds on multi-view and attention techniques.

The paper tackled the problem of generating stylized 3D objects from content and style images without case-specific training, achieving instant stylization with improved computational efficiency and visual quality compared to existing methods.

We present Style3D, a novel approach for generating stylized 3D objects from a content image and a style image. Unlike most previous methods that require case- or style-specific training, Style3D supports instant 3D object stylization. Our key insight is that 3D object stylization can be decomposed into two interconnected processes: multi-view dual-feature alignment and sparse-view spatial reconstruction. We introduce MultiFusion Attention, an attention-guided technique to achieve multi-view stylization from the content-style pair. Specifically, the query features from the content image preserve geometric consistency across multiple views, while the key and value features from the style image are used to guide the stylistic transfer. This dual-feature alignment ensures that spatial coherence and stylistic fidelity are maintained across multi-view images. Finally, a large 3D reconstruction model is introduced to generate coherent stylized 3D objects. By establishing an interplay between structural and stylistic features across multiple views, our approach enables a holistic 3D stylization process. Extensive experiments demonstrate that Style3D offers a more flexible and scalable solution for generating style-consistent 3D assets, surpassing existing methods in both computational efficiency and visual quality.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes