NeSy4VRD: A Multifaceted Resource for Neurosymbolic AI Research using Knowledge Graphs in Visual Relationship Detection
This resource addresses the need for standardized tools in the computer vision, neurosymbolic AI, and Semantic Web communities, though it is incremental as it builds upon existing datasets.
The authors tackled the lack of accessible, high-quality resources for neurosymbolic AI research by introducing NeSy4VRD, a multifaceted resource that re-establishes public access to VRD dataset images, provides revised annotations, and includes an OWL ontology and open-source infrastructure.
NeSy4VRD is a multifaceted resource designed to support the development of neurosymbolic AI (NeSy) research. NeSy4VRD re-establishes public access to the images of the VRD dataset and couples them with an extensively revised, quality-improved version of the VRD visual relationship annotations. Crucially, NeSy4VRD provides a well-aligned, companion OWL ontology that describes the dataset domain.It comes with open source infrastructure that provides comprehensive support for extensibility of the annotations (which, in turn, facilitates extensibility of the ontology), and open source code for loading the annotations to/from a knowledge graph. We are contributing NeSy4VRD to the computer vision, NeSy and Semantic Web communities to help foster more NeSy research using OWL-based knowledge graphs.