Use of Solr and Xapian in the Invenio document repository software
This work addresses the need for improved search performance in institutional repositories and digital libraries, though it is incremental as it adapts existing search engines to an existing software framework.
The paper tackled the integration of Solr and Xapian into the Invenio document repository software to enhance full-text search and ranking capabilities, resulting in efficient search functionality for multi-million record repositories like the CERN Document Server.
Invenio is a free comprehensive web-based document repository and digital library software suite originally developed at CERN. It can serve a variety of use cases from an institutional repository or digital library to a web journal. In order to fully use full-text documents for efficient search and ranking, Solr was integrated into Invenio through a generic bridge. Solr indexes extracted full-texts and most relevant metadata. Consequently, Invenio takes advantage of Solr's efficient search and word similarity ranking capabilities. In this paper, we first give an overview of Invenio, its capabilities and features. We then present our open source Solr integration as well as scalability challenges that arose for an Invenio-based multi-million record repository: the CERN Document Server. We also compare our Solr adapter to an alternative Xapian adapter using the same generic bridge. Both integrations are distributed with the Invenio package and ready to be used by the institutions using or adopting Invenio.