IoU-uniform R-CNN: Breaking Through the Limitations of RPN
This work addresses a specific bottleneck in two-stage object detectors, offering an incremental improvement for computer vision applications.
The paper tackles the problem of imbalanced IoU distribution and insufficient training samples in Region Proposal Networks (RPNs) for object detection, proposing IoU-Uniform R-CNN to generate uniformly distributed samples and improve IoU prediction, resulting in enhanced performance on PASCAL VOC and MS COCO datasets.
Region Proposal Network (RPN) is the cornerstone of two-stage object detectors, it generates a sparse set of object proposals and alleviates the extrem foregroundbackground class imbalance problem during training. However, we find that the potential of the detector has not been fully exploited due to the IoU distribution imbalance and inadequate quantity of the training samples generated by RPN. With the increasing intersection over union (IoU), the exponentially smaller numbers of positive samples would lead to the distribution skewed towards lower IoUs, which hinders the optimization of detector at high IoU levels. In this paper, to break through the limitations of RPN, we propose IoU-Uniform R-CNN, a simple but effective method that directly generates training samples with uniform IoU distribution for the regression branch as well as the IoU prediction branch. Besides, we improve the performance of IoU prediction branch by eliminating the feature offsets of RoIs at inference, which helps the NMS procedure by preserving accurately localized bounding box. Extensive experiments on the PASCAL VOC and MS COCO dataset show the effectiveness of our method, as well as its compatibility and adaptivity to many object detection architectures. The code is made publicly available at https://github.com/zl1994/IoU-Uniform-R-CNN,