The ADAIO System at the BEA-2023 Shared Task on Generating AI Teacher Responses in Educational Dialogues
This work addresses the challenge of creating effective AI teachers for educational applications, but it is incremental as it applies existing methods to a specific shared task.
The paper tackled the problem of generating AI teacher responses in educational dialogues by evaluating baseline models using OpenAI GPT-3 and designing prompts, achieving second place in the BEA-2023 shared task with a few-shot prompt-based approach using the text-davinci-003 model.
This paper presents the ADAIO team's system entry in the Building Educational Applications (BEA) 2023 Shared Task on Generating AI Teacher Responses in Educational Dialogues. The task aims to assess the performance of state-of-the-art generative models as AI teachers in producing suitable responses within a student-teacher dialogue. Our system comprises evaluating various baseline models using OpenAI GPT-3 and designing diverse prompts to prompt the OpenAI models for teacher response generation. After the challenge, our system achieved second place by employing a few-shot prompt-based approach with the OpenAI text-davinci-003 model. The results highlight the few-shot learning capabilities of large-language models, particularly OpenAI's GPT-3, in the role of AI teachers.