2.0AINov 25, 2019
Bridging the Gap between Semantics and Multimedia ProcessingMarcio Ferreira Moreno, Guilherme Lima, Rodrigo Costa Mesquita Santos et al.
In this paper, we give an overview of the semantic gap problem in multimedia and discuss how machine learning and symbolic AI can be combined to narrow this gap. We describe the gap in terms of a classical architecture for multimedia processing and discuss a structured approach to bridge it. This approach combines machine learning (for mapping signals to objects) and symbolic AI (for linking objects to meanings). Our main goal is to raise awareness and discuss the challenges involved in this structured approach to multimedia understanding, especially in the view of the latest developments in machine learning and symbolic AI.
3.6AINov 19, 2019
Multimedia Search and Temporal ReasoningMarcio Ferreira Moreno, Rodrigo Costa Mesquita Santos, Wallas Henrique Sousa dos Santos et al.
Properly modelling dynamic information that changes over time still is an open issue. Most modern knowledge bases are unable to represent relationships that are valid only during a given time interval. In this work, we revisit a previous extension to the hyperknowledge framework to deal with temporal facts and propose a temporal query language and engine. We validate our proposal by discussing a qualitative analysis of the modelling of a real-world use case in the Oil & Gas industry.
3.6AISep 9, 2019
General Fragment Model for Information ArtifactsSandro Rama Fiorini, Wallas Sousa dos Santos, Rodrigo Costa Mesquita et al.
The use of semantic descriptions in data intensive domains require a systematic model for linking semantic descriptions with their manifestations in fragments of heterogeneous information and data objects. Such information heterogeneity requires a fragment model that is general enough to support the specification of anchors from conceptual models to multiple types of information artifacts. While diverse proposals of anchoring models exist in the literature, they are usually focused in audiovisual information. We propose a generalized fragment model that can be instantiated to different kinds of information artifacts. Our objective is to systematize the way in which fragments and anchors can be described in conceptual models, without committing to a specific vocabulary.