DepthArb: Training-Free Depth-Arbitrated Generation for Occlusion-Robust Image Synthesis
This addresses occlusion issues in image synthesis for users of generative models, offering a plug-and-play solution, though it is incremental as it builds on existing layout-guided methods.
The paper tackles the problem of inaccurate occlusion relationships in text-to-image diffusion models, particularly in dense overlapping regions, by proposing DepthArb, a training-free framework that resolves occlusion ambiguities through attention arbitration, resulting in consistent outperformance of state-of-the-art baselines in occlusion accuracy and visual fidelity.
Text-to-image diffusion models frequently exhibit deficiencies in synthesizing accurate occlusion relationships of multiple objects, particularly within dense overlapping regions. Existing training-free layout-guided methods predominantly rely on rigid spatial priors that remain agnostic to depth order, often resulting in concept mixing or illogical occlusion. To address these limitations, we propose DepthArb, a training-free framework that resolves occlusion ambiguities by arbitrating attention competition between interacting objects. Specifically, DepthArb employs two core mechanisms: Attention Arbitration Modulation (AAM), which enforces depth-ordered visibility by suppressing background activations in overlapping regions, and Spatial Compactness Control (SCC), which preserves structural integrity by curbing attention divergence. These mechanisms enable robust occlusion generation without model retraining. To systematically evaluate this capability, we propose OcclBench, a comprehensive benchmark designed to evaluate diverse occlusion scenarios. Extensive evaluations demonstrate that DepthArb consistently outperforms state-of-the-art baselines in both occlusion accuracy and visual fidelity. As a plug-and-play method, DepthArb seamlessly enhances the compositional capabilities of diffusion backbones, offering a novel perspective on spatial layering within generative models.