Sabiá: Um Chatbot de Inteligência Artificial Generativa para Suporte no Dia a Dia do Ensino Superior
This addresses day-to-day information access issues for university students, but it is incremental as it applies existing AI methods to a specific educational context.
The paper tackled the problem of students struggling to access fragmented academic information by developing a chatbot using Generative AI and RAG, with Gemini 2.0 Flash and Gemma 3n identified as top-performing models based on quality metrics and LLM-as-a-Judge evaluation.
Students often report difficulties in accessing day-to-day academic information, which is usually spread across numerous institutional documents and websites. This fragmentation results in a lack of clarity and causes confusion about routine university information. This project proposes the development of a chatbot using Generative Artificial Intelligence (GenAI) and Retrieval-Augmented Generation (RAG) to simplify access to such information. Several GenAI models were tested and evaluated based on quality metrics and the LLM-as-a-Judge approach. Among them, Gemini 2.0 Flash stood out for its quality and speed, and Gemma 3n for its good performance and open-source nature.