CVAIMay 23, 2023

Variational Bayesian Framework for Advanced Image Generation with Domain-Related Variables

arXiv:2305.13872v1
Originality Incremental advance
AI Analysis

This addresses the problem of enabling multiple applications like image-to-image translation and editing without annotations for researchers and practitioners in computer vision.

The paper tackles the challenge of advanced conditional generative problems without annotations by proposing a variational Bayesian image translation network (VBITN) that enables multiple image translation and editing tasks, with comprehensive experiments demonstrating effectiveness on unsupervised image-to-image translation.

Deep generative models (DGMs) and their conditional counterparts provide a powerful ability for general-purpose generative modeling of data distributions. However, it remains challenging for existing methods to address advanced conditional generative problems without annotations, which can enable multiple applications like image-to-image translation and image editing. We present a unified Bayesian framework for such problems, which introduces an inference stage on latent variables within the learning process. In particular, we propose a variational Bayesian image translation network (VBITN) that enables multiple image translation and editing tasks. Comprehensive experiments show the effectiveness of our method on unsupervised image-to-image translation, and demonstrate the novel advanced capabilities for semantic editing and mixed domain translation.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes