CVDec 22, 2024

Pinwheel-shaped Convolution and Scale-based Dynamic Loss for Infrared Small Target Detection

arXiv:2412.16986v1193 citationsh-index: 2Has CodeAAAI
Originality Incremental advance
AI Analysis

This work addresses the problem of detecting dim, small targets in infrared images for applications like surveillance, but it is incremental as it builds on existing CNN-based methods with specific enhancements.

The authors tackled infrared small target detection by proposing a pinwheel-shaped convolution (PConv) to better match the Gaussian spatial distribution of targets and a scale-based dynamic (SD) loss to adjust loss influence based on target size, achieving significant performance improvements on datasets like IRSTD-1K and their new SIRST-UAVB benchmark.

These recent years have witnessed that convolutional neural network (CNN)-based methods for detecting infrared small targets have achieved outstanding performance. However, these methods typically employ standard convolutions, neglecting to consider the spatial characteristics of the pixel distribution of infrared small targets. Therefore, we propose a novel pinwheel-shaped convolution (PConv) as a replacement for standard convolutions in the lower layers of the backbone network. PConv better aligns with the pixel Gaussian spatial distribution of dim small targets, enhances feature extraction, significantly increases the receptive field, and introduces only a minimal increase in parameters. Additionally, while recent loss functions combine scale and location losses, they do not adequately account for the varying sensitivity of these losses across different target scales, limiting detection performance on dim-small targets. To overcome this, we propose a scale-based dynamic (SD) Loss that dynamically adjusts the influence of scale and location losses based on target size, improving the network's ability to detect targets of varying scales. We construct a new benchmark, SIRST-UAVB, which is the largest and most challenging dataset to date for real-shot single-frame infrared small target detection. Lastly, by integrating PConv and SD Loss into the latest small target detection algorithms, we achieved significant performance improvements on IRSTD-1K and our SIRST-UAVB dataset, validating the effectiveness and generalizability of our approach. Code -- https://github.com/JN-Yang/PConv-SDloss-Data

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes