MatSSL: Robust Self-Supervised Representation Learning for Metallographic Image Segmentation
This addresses the need for robust segmentation in metallographic analysis, offering a domain-specific solution that reduces reliance on large labeled datasets, though it is incremental as it builds on existing SSL techniques.
The paper tackles the problem of inconsistent performance in metallographic image segmentation with limited labeled data by introducing MatSSL, a self-supervised learning architecture that achieves 69.13% mIoU on MetalDAM and up to nearly 40% improvement on the EBC benchmark compared to existing methods.
MatSSL is a streamlined self-supervised learning (SSL) architecture that employs Gated Feature Fusion at each stage of the backbone to integrate multi-level representations effectively. Current micrograph analysis of metallic materials relies on supervised methods, which require retraining for each new dataset and often perform inconsistently with only a few labeled samples. While SSL offers a promising alternative by leveraging unlabeled data, most existing methods still depend on large-scale datasets to be effective. MatSSL is designed to overcome this limitation. We first perform self-supervised pretraining on a small-scale, unlabeled dataset and then fine-tune the model on multiple benchmark datasets. The resulting segmentation models achieve 69.13% mIoU on MetalDAM, outperforming the 66.73% achieved by an ImageNet-pretrained encoder, and delivers consistently up to nearly 40% improvement in average mIoU on the Environmental Barrier Coating benchmark dataset (EBC) compared to models pretrained with MicroNet. This suggests that MatSSL enables effective adaptation to the metallographic domain using only a small amount of unlabeled data, while preserving the rich and transferable features learned from large-scale pretraining on natural images.