Unpaired Image-to-Image Translation with Limited Data to Reveal Subtle Phenotypes
This work addresses a bottleneck in biological applications where subtle cell phenotype variations need visualization but data is scarce, offering an incremental improvement over existing methods.
The paper tackled the problem of unpaired image-to-image translation with limited data, common in microscopy experiments, by proposing an improved CycleGAN architecture with self-supervised discriminators, resulting in quantitative and qualitative outperformance over baselines, including when combined with differentiable augmentations.
Unpaired image-to-image translation methods aim at learning a mapping of images from a source domain to a target domain. Recently, these methods proved to be very useful in biological applications to display subtle phenotypic cell variations otherwise invisible to the human eye. However, current models require a large number of images to be trained, while mostmicroscopy experiments remain limited in the number of images they can produce. In this work, we present an improved CycleGAN architecture that employs self-supervised discriminators to alleviate the need for numerous images. We demonstrate quantitatively and qualitatively that the proposed approach outperforms the CycleGAN baseline, including when it is combined with differentiable augmentations. We also provide results obtained with small biological datasets on obvious and non-obvious cell phenotype variations, demonstrating a straightforward application of this method.