MARAGS: A Multi-Adapter System for Multi-Task Retrieval Augmented Generation Question Answering
This work addresses realistic question-answering tasks in retrieval-augmented generation for competition participants, but it is incremental as it builds on standard setups with adapters.
The paper tackles multi-task retrieval-augmented generation question answering by developing a multi-adapter system (MARAGS) for Meta's CRAG competition, achieving 2nd place on Task 1 and 3rd place on Task 2.
In this paper we present a multi-adapter retrieval augmented generation system (MARAGS) for Meta's Comprehensive RAG (CRAG) competition for KDD CUP 2024. CRAG is a question answering dataset contains 3 different subtasks aimed at realistic question and answering RAG related tasks, with a diverse set of question topics, question types, time dynamic answers, and questions featuring entities of varying popularity. Our system follows a standard setup for web based RAG, which uses processed web pages to provide context for an LLM to produce generations, while also querying API endpoints for additional information. MARAGS also utilizes multiple different adapters to solve the various requirements for these tasks with a standard cross-encoder model for ranking candidate passages relevant for answering the question. Our system achieved 2nd place for Task 1 as well as 3rd place on Task 2.