DiffTex: Differentiable Texturing for Architectural Proxy Models
This addresses the challenge of texture loss in architectural modeling for applications like real-time rendering, though it is incremental as it builds on existing differentiable rendering techniques.
The paper tackled the problem of generating realistic texture maps for simplified architectural proxy models from unordered photographs, achieving high-quality textures that preserve visual fidelity and structural detail through an automated differentiable rendering method.
Simplified proxy models are commonly used to represent architectural structures, reducing storage requirements and enabling real-time rendering. However, the geometric simplifications inherent in proxies result in a loss of fine color and geometric details, making it essential for textures to compensate for the loss. Preserving the rich texture information from the original dense architectural reconstructions remains a daunting task, particularly when working with unordered RGB photographs. We propose an automated method for generating realistic texture maps for architectural proxy models at the texel level from an unordered collection of registered photographs. Our approach establishes correspondences between texels on a UV map and pixels in the input images, with each texel's color computed as a weighted blend of associated pixel values. Using differentiable rendering, we optimize blending parameters to ensure photometric and perspective consistency, while maintaining seamless texture coherence. Experimental results demonstrate the effectiveness and robustness of our method across diverse architectural models and varying photographic conditions, enabling the creation of high-quality textures that preserve visual fidelity and structural detail.