Image Super Resolution via Bilinear Pooling: Application to Confocal Endomicroscopy
This work addresses image quality degradation in clinical endomicroscopy, offering a lightweight solution for real-time applications, but it is incremental as it builds on existing super-resolution techniques.
The paper tackles the problem of low-resolution images from miniaturized confocal endomicroscopes by proposing a novel attention mechanism using bilinear pooling, achieving competitive results on PSNR, SSIM, and IFC metrics compared to 11 existing super-resolution methods.
Recent developments in image acquisition literature have miniaturized the confocal laser endomicroscopes to improve usability and flexibility of the apparatus in actual clinical settings. However, miniaturized devices collect less light and have fewer optical components, resulting in pixelation artifacts and low resolution images. Owing to the strength of deep networks, many supervised methods known as super resolution have achieved considerable success in restoring low resolution images by generating the missing high frequency details. In this work, we propose a novel attention mechanism that, for the first time, combines 1st- and 2nd-order statistics for pooling operation, in the spatial and channel-wise dimensions. We compare the efficacy of our method to 11 other existing single image super resolution techniques that compensate for the reduction in image quality caused by the necessity of endomicroscope miniaturization. All evaluations are carried out on three publicly available datasets. Experimental results show that our method can produce competitive results against state-of-the-art in terms of PSNR, SSIM, and IFC metrics. Additionally, our proposed method contains small number of parameters, which makes it lightweight and fast for real-time applications.