CellSegmenter: unsupervised representation learning and instance segmentation of modular images
This work addresses the problem of instance segmentation for modular images, which is relevant for researchers working with image analysis, particularly in biological imaging.
This paper introduces CellSegmenter, an unsupervised method for instance segmentation and representation learning. It achieves nearly perfect accuracy on a synthetic multi-MNIST dataset and provides high-quality segmentations for cell nuclei images.
We introduce CellSegmenter, a structured deep generative model and an amortized inference framework for unsupervised representation learning and instance segmentation tasks. The proposed inference algorithm is convolutional and parallelized, without any recurrent mechanisms, and is able to resolve object-object occlusion while simultaneously treating distant non-occluding objects independently. This leads to extremely fast training times while allowing extrapolation to arbitrary number of instances. We further introduce a transparent posterior regularization strategy that encourages scene reconstructions with fewest localized objects and a low-complexity background. We evaluate our method on a challenging synthetic multi-MNIST dataset with a structured background and achieve nearly perfect accuracy with only a few hundred training epochs. Finally, we show segmentation results obtained for a cell nuclei imaging dataset, demonstrating the ability of our method to provide high-quality segmentations while also handling realistic use cases involving large number of instances.