CVAIMMAug 16, 2023

Improving Anomaly Segmentation with Multi-Granularity Cross-Domain Alignment

CMUUW
arXiv:2308.08696v29 citationsh-index: 26
Originality Incremental advance
AI Analysis

This work addresses the critical issue of domain gap in anomaly segmentation for autonomous driving systems, representing an incremental improvement with novel method components.

The paper tackles the problem of anomaly segmentation in images, particularly for hazard detection in autonomous driving, by addressing the domain disparity between synthetic and real-world data, resulting in superior performance on benchmarks like Fishyscapes and RoadAnomaly.

Anomaly segmentation plays a pivotal role in identifying atypical objects in images, crucial for hazard detection in autonomous driving systems. While existing methods demonstrate noteworthy results on synthetic data, they often fail to consider the disparity between synthetic and real-world data domains. Addressing this gap, we introduce the Multi-Granularity Cross-Domain Alignment (MGCDA) framework, tailored to harmonize features across domains at both the scene and individual sample levels. Our contributions are twofold: i) We present the Multi-source Domain Adversarial Training module. This integrates a multi-source adversarial loss coupled with dynamic label smoothing, facilitating the learning of domain-agnostic representations across multiple processing stages. ii) We propose an innovative Cross-domain Anomaly-aware Contrastive Learning methodology.} This method adeptly selects challenging anchor points and images using an anomaly-centric strategy, ensuring precise alignment at the sample level. Extensive evaluations of the Fishyscapes and RoadAnomaly datasets demonstrate MGCDA's superior performance and adaptability. Additionally, its ability to perform parameter-free inference and function with various network architectures highlights its distinctiveness in advancing the frontier of anomaly segmentation.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes