CVCLLGDec 9, 2021

Self-Supervised Image-to-Text and Text-to-Image Synthesis

arXiv:2112.04928v11 citations
Originality Incremental advance
AI Analysis

This addresses the challenge of understanding vision-language relations for AI systems, but it is incremental as it builds on existing methods like StackGAN and LSTM.

The paper tackles the problem of learning cross-modal embeddings for image-to-text and text-to-image synthesis by proposing a self-supervised deep learning approach, resulting in a model that generates textual descriptions from images and images from text both qualitatively and quantitatively.

A comprehensive understanding of vision and language and their interrelation are crucial to realize the underlying similarities and differences between these modalities and to learn more generalized, meaningful representations. In recent years, most of the works related to Text-to-Image synthesis and Image-to-Text generation, focused on supervised generative deep architectures to solve the problems, where very little interest was placed on learning the similarities between the embedding spaces across modalities. In this paper, we propose a novel self-supervised deep learning based approach towards learning the cross-modal embedding spaces; for both image to text and text to image generations. In our approach, we first obtain dense vector representations of images using StackGAN-based autoencoder model and also dense vector representations on sentence-level utilizing LSTM based text-autoencoder; then we study the mapping from embedding space of one modality to embedding space of the other modality utilizing GAN and maximum mean discrepancy based generative networks. We, also demonstrate that our model learns to generate textual description from image data as well as images from textual data both qualitatively and quantitatively.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes