PSTNet: Enhanced Polyp Segmentation with Multi-scale Alignment and Frequency Domain Integration
This work addresses the need for more accurate computer-assisted diagnosis of colorectal cancer, though it appears incremental as it builds on existing deep learning methods by adding frequency domain integration.
The paper tackled the problem of accurately segmenting colorectal polyps in colonoscopy images by proposing PSTNet, which integrates RGB and frequency domain cues with multi-scale alignment, resulting in significant improvements in segmentation accuracy over state-of-the-art methods on challenging datasets.
Accurate segmentation of colorectal polyps in colonoscopy images is crucial for effective diagnosis and management of colorectal cancer (CRC). However, current deep learning-based methods primarily rely on fusing RGB information across multiple scales, leading to limitations in accurately identifying polyps due to restricted RGB domain information and challenges in feature misalignment during multi-scale aggregation. To address these limitations, we propose the Polyp Segmentation Network with Shunted Transformer (PSTNet), a novel approach that integrates both RGB and frequency domain cues present in the images. PSTNet comprises three key modules: the Frequency Characterization Attention Module (FCAM) for extracting frequency cues and capturing polyp characteristics, the Feature Supplementary Alignment Module (FSAM) for aligning semantic information and reducing misalignment noise, and the Cross Perception localization Module (CPM) for synergizing frequency cues with high-level semantics to achieve efficient polyp segmentation. Extensive experiments on challenging datasets demonstrate PSTNet's significant improvement in polyp segmentation accuracy across various metrics, consistently outperforming state-of-the-art methods. The integration of frequency domain cues and the novel architectural design of PSTNet contribute to advancing computer-assisted polyp segmentation, facilitating more accurate diagnosis and management of CRC.