Quantitative Analysis of Automatic Image Cropping Algorithms: A Dataset and Comparative Study
This work addresses the need for improved visual quality in digital photos for users, but it is incremental as it builds on existing methods with a new dataset.
The study tackled the problem of automatic image cropping by evaluating traditional and ranking-based methods, and introduced a new dataset with high-quality annotations for performance comparison.
Automatic photo cropping is an important tool for improving visual quality of digital photos without resorting to tedious manual selection. Traditionally, photo cropping is accomplished by determining the best proposal window through visual quality assessment or saliency detection. In essence, the performance of an image cropper highly depends on the ability to correctly rank a number of visually similar proposal windows. Despite the ranking nature of automatic photo cropping, little attention has been paid to learning-to-rank algorithms in tackling such a problem. In this work, we conduct an extensive study on traditional approaches as well as ranking-based croppers trained on various image features. In addition, a new dataset consisting of high quality cropping and pairwise ranking annotations is presented to evaluate the performance of various baselines. The experimental results on the new dataset provide useful insights into the design of better photo cropping algorithms.