CVNov 16, 2022

ELDA: Using Edges to Have an Edge on Semantic Segmentation Based UDA

U of Toronto
arXiv:2211.08888v12 citationsh-index: 8
Originality Incremental advance
AI Analysis

This work addresses domain adaptation challenges in semantic segmentation, offering a more efficient alternative to depth-based methods, though it appears incremental as it builds on existing UDA frameworks.

The paper tackles the problem of high cost and unreliable prediction quality in unsupervised domain adaptation for semantic segmentation by using depth as domain invariant information, and introduces ELDA which incorporates edge information to outperform state-of-the-art methods on two benchmarks.

Many unsupervised domain adaptation (UDA) methods have been proposed to bridge the domain gap by utilizing domain invariant information. Most approaches have chosen depth as such information and achieved remarkable success. Despite their effectiveness, using depth as domain invariant information in UDA tasks may lead to multiple issues, such as excessively high extraction costs and difficulties in achieving a reliable prediction quality. As a result, we introduce Edge Learning based Domain Adaptation (ELDA), a framework which incorporates edge information into its training process to serve as a type of domain invariant information. In our experiments, we quantitatively and qualitatively demonstrate that the incorporation of edge information is indeed beneficial and effective and enables ELDA to outperform the contemporary state-of-the-art methods on two commonly adopted benchmarks for semantic segmentation based UDA tasks. In addition, we show that ELDA is able to better separate the feature distributions of different classes. We further provide an ablation analysis to justify our design decisions.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes