CYAIJan 24, 2025

A Zero-Shot LLM Framework for Automatic Assignment Grading in Higher Education

arXiv:2501.14305v112 citationsh-index: 8
Originality Incremental advance
AI Analysis

This addresses the need for scalable, personalized feedback in higher education, though it is incremental as it builds on existing LLM capabilities.

The paper tackled the problem of automated grading in education by proposing a zero-shot LLM framework that evaluates student assignments without training, and demonstrated its effectiveness through student surveys showing improved motivation and understanding compared to traditional methods.

Automated grading has become an essential tool in education technology due to its ability to efficiently assess large volumes of student work, provide consistent and unbiased evaluations, and deliver immediate feedback to enhance learning. However, current systems face significant limitations, including the need for large datasets in few-shot learning methods, a lack of personalized and actionable feedback, and an overemphasis on benchmark performance rather than student experience. To address these challenges, we propose a Zero-Shot Large Language Model (LLM)-Based Automated Assignment Grading (AAG) system. This framework leverages prompt engineering to evaluate both computational and explanatory student responses without requiring additional training or fine-tuning. The AAG system delivers tailored feedback that highlights individual strengths and areas for improvement, thereby enhancing student learning outcomes. Our study demonstrates the system's effectiveness through comprehensive evaluations, including survey responses from higher education students that indicate significant improvements in motivation, understanding, and preparedness compared to traditional grading methods. The results validate the AAG system's potential to transform educational assessment by prioritizing learning experiences and providing scalable, high-quality feedback.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes