Creating Multimedia Summaries Using Tweets and Videos
This addresses the need for efficient multimedia summaries of popular events for viewers and analysts, but it is incremental as it builds on existing methods for event detection and content selection.
The paper tackles the problem of summarizing televised events by combining social media commentary and video content, resulting in an automated system that identifies key scenes based on mention spikes and selects relevant tweets and video frames.
While popular televised events such as presidential debates or TV shows are airing, people provide commentary on them in real-time. In this paper, we propose a simple yet effective approach to combine social media commentary and videos to create a multimedia summary of televised events. Our approach identifies scenes from these events based on spikes of mentions of people involved in the event and automatically selects tweets and frames from the videos that occur during the time period of the spike that talk about and show the people being discussed.