DayDreamer at CQs-Gen 2025: Generating Critical Questions through Argument Scheme Completion
This work addresses the need for automated tools to foster critical thinking in argument analysis, though it is incremental as it builds on existing LLM and argumentation theory methods.
The authors tackled the problem of generating critical questions from argumentative text by using large language models with chain-of-thought prompting guided by Walton's argumentation schemes, achieving competitive performance on the CQs-Gen 2025 test set.
Critical questions are essential resources to provoke critical thinking when encountering an argumentative text. We present our system for the Critical Questions Generation (CQs-Gen) Shared Task at ArgMining 2025. Our approach leverages large language models (LLMs) with chain-of-thought prompting to generate critical questions guided by Walton's argumentation schemes. For each input intervention, we conversationally prompt LLMs to instantiate the corresponding argument scheme template to first obtain structured arguments, and then generate relevant critical questions. Following this, we rank all the available critical questions by prompting LLMs to select the top 3 most helpful questions based on the original intervention text. This combination of structured argumentation theory and step-by-step reasoning enables the generation of contextually relevant and diverse critical questions. Our pipeline achieves competitive performance in the final test set, showing its potential to foster critical thinking given argumentative text and detect missing or uninformed claims. Code available at \href{https://git.ecdf.ed.ac.uk/s2236454/DayDreamer-CQs-Gen}{DayDreamer}.