LGMLFeb 5, 2019

TzK: Flow-Based Conditional Generative Model

arXiv:1902.01893v47 citations
AI Analysis

This enables more flexible conditional generative modeling for applications requiring integration of diverse data sources.

The paper tackles the problem of training generative models from multiple heterogeneous datasets without requiring prior knowledge about class relationships, achieving log likelihood comparable to state-of-the-art methods and producing compelling conditional samples.

We formulate a new class of conditional generative models based on probability flows. Trained with maximum likelihood, it provides efficient inference and sampling from class-conditionals or the joint distribution, and does not require a priori knowledge of the number of classes or the relationships between classes. This allows one to train generative models from multiple, heterogeneous datasets, while retaining strong prior models over subsets of the data (e.g., from a single dataset, class label, or attribute). In this paper, in addition to end-to-end learning, we show how one can learn a single model from multiple datasets with a relatively weak Glow architecture, and then extend it by conditioning on different knowledge types (e.g., a single dataset). This yields log likelihood comparable to state-of-the-art, compelling samples from conditional priors.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes