Few-shot Personalized Saliency Prediction Based on Interpersonal Gaze Patterns
This work addresses the problem of personalized visual attention prediction for individuals in computer vision, but it is incremental as it builds on existing methods for saliency prediction.
The study tackled the challenge of predicting personalized saliency maps (PSMs) from limited eye-tracking data by leveraging interpersonal gaze patterns, resulting in improved few-shot PSM prediction through image selection for diverse gaze patterns and tensor-based regression to preserve structural information.
This study proposes a few-shot personalized saliency prediction method that leverages interpersonal gaze patterns. Unlike general saliency maps, personalized saliency maps (PSMs) capture individual visual attention and provide insights into individual visual preferences. However, predicting PSMs is challenging because of the complexity of gaze patterns and the difficulty of collecting extensive eye-tracking data from individuals. An effective strategy for predicting PSMs from limited data is the use of eye-tracking data from other persons. To efficiently handle the PSMs of other persons, this study focuses on the selection of images to acquire eye-tracking data and the preservation of the structural information of PSMs. In the proposed method, these images are selected such that they bring more diverse gaze patterns to persons, and structural information is preserved using tensor-based regression. The experimental results demonstrate that these two factors are beneficial for few-shot PSM prediction.