NOVI : Chatbot System for University Novice with BERT and LLMs
This is an incremental application of existing methods to help university freshmen and potentially others adapt to new environments.
The researchers tackled the problem of university freshmen struggling to adapt by developing NOVI, a chatbot system based on GPT-4o that uses data from a university community site, achieving performance evaluated with metrics like BLEU, Perplexity, ROUGE, and METEOR scores.
To mitigate the difficulties of university freshmen in adapting to university life, we developed NOVI, a chatbot system based on GPT-4o. This system utilizes post and comment data from SKKU 'Everytime', a university community site. Developed using LangChain, NOVI's performance has been evaluated with a BLEU score, Perplexity score, ROUGE-1 score, ROUGE-2 score, ROUGE-L score and METEOR score. This approach is not only limited to help university freshmen but is also expected to help various people adapting to new environments with different data. This research explores the development and potential application of new educational technology tools, contributing to easier social adaptation for beginners and settling a foundation for future advancement in LLM studies.