IRAug 3, 2021

iART: A Search Engine for Art-Historical Images to Support Research in the Humanities

arXiv:2108.01542v118 citations
Originality Synthesis-oriented
AI Analysis

This work addresses the problem of efficient image-based research for art historians, though it appears incremental as it builds on existing machine learning techniques for a specific domain.

The paper tackles the challenge of comparative art-historical research by introducing iART, an open web platform that integrates machine learning for image retrieval and clustering, resulting in a system that enables searches for previously undetected concepts using cross-modal deep learning and provides access to large collections like the Amsterdam Rijksmuseum and Wikidata.

In this paper, we introduce iART: an open Web platform for art-historical research that facilitates the process of comparative vision. The system integrates various machine learning techniques for keyword- and content-based image retrieval as well as category formation via clustering. An intuitive GUI supports users to define queries and explore results. By using a state-of-the-art cross-modal deep learning approach, it is possible to search for concepts that were not previously detected by trained classification models. Art-historical objects from large, openly licensed collections such as Amsterdam Rijksmuseum and Wikidata are made available to users.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes