Evaluating LLMs on Chinese Topic Constructions: A Research Proposal Inspired by Tian et al. (2024)
It addresses the problem of evaluating LLMs' grammatical knowledge in Mandarin syntax for researchers, but it is incremental as it builds on prior work and lacks new results.
This paper proposes a framework for evaluating large language models on Chinese topic constructions to assess their sensitivity to island constraints, aiming to establish a foundation for future studies without conducting experiments.
This paper proposes a framework for evaluating large language models (LLMs) on Chinese topic constructions, focusing on their sensitivity to island constraints. Drawing inspiration from Tian et al. (2024), we outline an experimental design for testing LLMs' grammatical knowledge of Mandarin syntax. While no experiments have been conducted yet, this proposal aims to provide a foundation for future studies and invites feedback on the methodology.