CVJul 18, 2024

WiNet: Wavelet-based Incremental Learning for Efficient Medical Image Registration

arXiv:2407.13426v121 citationsh-index: 17Has Code
Originality Incremental advance
AI Analysis

This work addresses efficiency and explainability issues in medical image registration, offering an incremental improvement over existing coarse-to-fine methods.

The paper tackles the high memory usage and lack of explainability in deep image registration methods by introducing WiNet, a wavelet-based incremental learning approach that estimates scale-wise coefficients to reconstruct deformation fields, achieving competitive accuracy and GPU efficiency on two 3D datasets.

Deep image registration has demonstrated exceptional accuracy and fast inference. Recent advances have adopted either multiple cascades or pyramid architectures to estimate dense deformation fields in a coarse-to-fine manner. However, due to the cascaded nature and repeated composition/warping operations on feature maps, these methods negatively increase memory usage during training and testing. Moreover, such approaches lack explicit constraints on the learning process of small deformations at different scales, thus lacking explainability. In this study, we introduce a model-driven WiNet that incrementally estimates scale-wise wavelet coefficients for the displacement/velocity field across various scales, utilizing the wavelet coefficients derived from the original input image pair. By exploiting the properties of the wavelet transform, these estimated coefficients facilitate the seamless reconstruction of a full-resolution displacement/velocity field via our devised inverse discrete wavelet transform (IDWT) layer. This approach avoids the complexities of cascading networks or composition operations, making our WiNet an explainable and efficient competitor with other coarse-to-fine methods. Extensive experimental results from two 3D datasets show that our WiNet is accurate and GPU efficient. The code is available at https://github.com/x-xc/WiNet .

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes