The Anatomy of a Modular System for Media Content Analysis
This work addresses the need for automated media content analysis tools for social science researchers, but it is incremental as it builds on existing AI modules without introducing new methods.
The paper tackles the problem of integrating various AI algorithms into a single intelligent system for automating media content analysis in social science research, resulting in a flexible modular framework that has enabled a series of scientific studies across applications like comparative news analysis and public mood monitoring.
Intelligent systems for the annotation of media content are increasingly being used for the automation of parts of social science research. In this domain the problem of integrating various Artificial Intelligence (AI) algorithms into a single intelligent system arises spontaneously. As part of our ongoing effort in automating media content analysis for the social sciences, we have built a modular system by combining multiple AI modules into a flexible framework in which they can cooperate in complex tasks. Our system combines data gathering, machine translation, topic classification, extraction and annotation of entities and social networks, as well as many other tasks that have been perfected over the past years of AI research. Over the last few years, it has allowed us to realise a series of scientific studies over a vast range of applications including comparative studies between news outlets and media content in different countries, modelling of user preferences, and monitoring public mood. The framework is flexible and allows the design and implementation of modular agents, where simple modules cooperate in the annotation of a large dataset without central coordination.