Performance Comparison of Large Language Models on VNHSGE English Dataset: OpenAI ChatGPT, Microsoft Bing Chat, and Google Bard
This study provides insights into the potential of LLMs for English language education, particularly in Vietnam where ChatGPT is not officially available, though it is incremental as it applies existing methods to a new dataset.
This paper compared the performance of three large language models (OpenAI ChatGPT, Microsoft Bing Chat, and Google Bard) on the VNHSGE English dataset, finding that BingChat achieved 92.4%, Bard 86%, and ChatGPT 79.2%, with BingChat outperforming the others.
This paper presents a performance comparison of three large language models (LLMs), namely OpenAI ChatGPT, Microsoft Bing Chat (BingChat), and Google Bard, on the VNHSGE English dataset. The performance of BingChat, Bard, and ChatGPT (GPT-3.5) is 92.4\%, 86\%, and 79.2\%, respectively. The results show that BingChat is better than ChatGPT and Bard. Therefore, BingChat and Bard can replace ChatGPT while ChatGPT is not yet officially available in Vietnam. The results also indicate that BingChat, Bard and ChatGPT outperform Vietnamese students in English language proficiency. The findings of this study contribute to the understanding of the potential of LLMs in English language education. The remarkable performance of ChatGPT, BingChat, and Bard demonstrates their potential as effective tools for teaching and learning English at the high school level.