Avaliação de eficiência na leitura: uma abordagem baseada em PLN
This addresses the need for scalable and nuanced reading assessment in educational contexts, though it is incremental as it builds on existing cloze test methods.
The study tackled the problem of limited nuance in traditional cloze test correction by proposing an automated evaluation model for Brazilian Portuguese that integrates orthographic, grammatical, and semantic analyses, achieving a high correlation of 0.832 with human evaluation.
The cloze test, widely used due to its low cost and flexibility, makes it possible to assess reading comprehension by filling in gaps in texts, requiring the mobilization of diverse linguistic repertoires. However, traditional correction methods, based only on exact answers, limit the identification of nuances in student performance. This study proposes an automated evaluation model for the cloze test in Brazilian Portuguese, integrating orthographic (edit distance), grammatical (POS tagging) and semantic (similarity between embeddings) analyses. The integrated method demonstrated its effectiveness, achieving a high correlation with human evaluation (0.832). The results indicate that the automated approach is robust, sensitive to variations in linguistic repertoire and suitable for educational contexts that require scalability.