Multi-Agent Collaborative Framework For Math Problem Generation
This addresses the problem for educators and Intelligent Tutoring Systems by providing more pedagogically valuable automated content, though it appears incremental as it builds on existing transformer-based methods.
The paper tackles the challenge of automatically generating math problems with controlled complexity and cognitive demands by introducing a collaborative multi-agent framework that iteratively refines question-answer pairs. Preliminary evaluations show it elevates the quality of generated educational content by better balancing cognitive challenge and clarity.
Automatic question generation (AQG) for mathematics education remains an elusive goal for Intelligent Tutoring Systems and educators. While pre-trained transformer-based language models have significantly advanced natural language generation, they often struggle to precisely control problem complexity and cognitive demands. In this paper, we introduce a collaborative multi-agent framework as a novel method of incorporating inference-time computation into AQG. This approach leverages multiple agents that iteratively refine generated question-answer pairs to better balance complexity and cognitive demand. We evaluate the generated questions on five meta-evaluation criteria: relevance, importance, clarity, difficulty matching, answerability, to assess the system's ability to control the required complexity and quality of the questions. Preliminary evaluations show that this collaborative multi-agent framework elevates the quality of generated educational content by fostering a more nuanced balance between cognitive challenge and clarity. These promising outcomes suggest that integrating collaborative multi-agent workflows can yield more controlled, pedagogically valuable content that can help advance automated educational content generation and adaptive learning environments.