CVAIGRLGMar 19, 2024

TexTile: A Differentiable Metric for Texture Tileability

arXiv:2403.12961v18 citationsHas CodeCVPR
Originality Incremental advance
AI Analysis

This work addresses the need for better metrics in tileable texture synthesis for computer graphics and related fields, though it is incremental as it builds on existing classifiers and synthesis methods.

The authors tackled the problem of quantifying texture tileability by introducing TexTile, a differentiable metric that evaluates how well a texture can be concatenated without repeating artifacts, and demonstrated its effectiveness in improving texture synthesis methods and providing objective evaluation.

We introduce TexTile, a novel differentiable metric to quantify the degree upon which a texture image can be concatenated with itself without introducing repeating artifacts (i.e., the tileability). Existing methods for tileable texture synthesis focus on general texture quality, but lack explicit analysis of the intrinsic repeatability properties of a texture. In contrast, our TexTile metric effectively evaluates the tileable properties of a texture, opening the door to more informed synthesis and analysis of tileable textures. Under the hood, TexTile is formulated as a binary classifier carefully built from a large dataset of textures of different styles, semantics, regularities, and human annotations.Key to our method is a set of architectural modifications to baseline pre-train image classifiers to overcome their shortcomings at measuring tileability, along with a custom data augmentation and training regime aimed at increasing robustness and accuracy. We demonstrate that TexTile can be plugged into different state-of-the-art texture synthesis methods, including diffusion-based strategies, and generate tileable textures while keeping or even improving the overall texture quality. Furthermore, we show that TexTile can objectively evaluate any tileable texture synthesis method, whereas the current mix of existing metrics produces uncorrelated scores which heavily hinders progress in the field.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes