Experiences from the MediaEval Predicting Media Memorability Task
It provides collective lessons for the research community on media memorability prediction, but is incremental as it focuses on summarizing existing tasks and datasets.
The paper summarizes the MediaEval Predicting Media Memorability task, which has run annually since 2018, comparing various memorability prediction techniques on shared datasets to refine and improve them, with the resources now being used by researchers beyond the campaign.
The Predicting Media Memorability task in the MediaEval evaluation campaign has been running annually since 2018 and several different tasks and data sets have been used in this time. This has allowed us to compare the performance of many memorability prediction techniques on the same data and in a reproducible way and to refine and improve on those techniques. The resources created to compute media memorability are now being used by researchers well beyond the actual evaluation campaign. In this paper we present a summary of the task, including the collective lessons we have learned for the research community.