UniVerse: A Unified Modulation Framework for Segmentation-Free,Disentangled Multi-Concept Personalization
This work addresses the problem of multi-concept personalization in cluttered images for generative AI, offering a more flexible and interpretable approach without requiring segmentation masks.
UniVerse introduces a segmentation-free framework for disentangling and personalizing multiple concepts in diffusion transformers, achieving superior localization accuracy and visual fidelity over state-of-the-art baselines on multiple benchmarks.
Personalized visual understanding has advanced significantly, yet existing approaches struggle to localize and extract specific concepts when input images contain multiple objects. Many prior methods rely heavily on segmentation-based supervision or exhibit poor compositional generalization, limiting their ability to accurately disentangle and manipulate individual concepts. In this work, we propose UniVerse, a Unified Modulation Framework for segmentation-free, disentangled multi-concept personalization in diffusion transformers. Our method allows for composable and decomposable concept extraction, enabling fine-grained localization and representation of target objects without explicit segmentation masks. UniVerse learns to decompose complex scenes into concept-specific representations and then compose them in a unified manner, enabling robust personalization across diverse visual contexts. Through extensive experiments on multiple benchmarks, we demonstrate that UniVerse significantly outperforms state-of-the-art baselines in both localization accuracy and visual fidelity. Qualitative and quantitative results show that our approach can precisely extract target concepts in cluttered scenes, paving the way for more flexible, interpretable, and personalized visual generation and understanding.