MuMA: 3D PBR Texturing via Multi-Channel Multi-View Generation and Agentic Post-Processing
This addresses the challenge of high-quality 3D texturing for graphics and AI applications, but appears incremental as it builds on existing decomposition and multimodal models.
The paper tackles the problem of 3D physically based rendering (PBR) texturing, which suffers from limited data and multi-channel modeling challenges, by proposing MuMA, a method that achieves superior visual quality and material fidelity compared to existing methods.
Current methods for 3D generation still fall short in physically based rendering (PBR) texturing, primarily due to limited data and challenges in modeling multi-channel materials. In this work, we propose MuMA, a method for 3D PBR texturing through Multi-channel Multi-view generation and Agentic post-processing. Our approach features two key innovations: 1) We opt to model shaded and albedo appearance channels, where the shaded channels enables the integration intrinsic decomposition modules for material properties. 2) Leveraging multimodal large language models, we emulate artists' techniques for material assessment and selection. Experiments demonstrate that MuMA achieves superior results in visual quality and material fidelity compared to existing methods.