7.7HCMay 22
A Taxonomy of Metacognitive Learning Scenarios in Professional Contexts: Integrating Systems Theory with Empirical ConstraintsDavid C. Gibson, Mary Elizabeth Azukas, Meryem Yilmaz Soylu
Metacognitive theories provide foundational frameworks for understanding self-regulated learning, yet they lack systematic integration into comprehensive scenario taxonomies capable of guiding AI-enhanced professional development interventions. Existing models inadequately specify how metacognitive components combine into distinct learning scenarios or how professionals progress from novice to expert functioning. A six-node open systems model, consisting of Environment, Input, Processes, Structures, Output, and Feedback, was developed by synthesizing four major theoretical frameworks. Combinatorial enumeration generated 216 mathematically possible learning scenarios. Four sequential constraint-based filters, including psychological plausibility, educational relevance, measurement feasibility, and intervention potential, informed by empirical workplace learning research, reduced this space to 24 priority scenarios. Five focal scenarios were subjected to formal concept analysis. The 24 priority scenarios were distributed across three developmental tiers: novice, with 6 scenarios; developing, with 10 scenarios; and expert/adaptive, with 8 scenarios. Analysis revealed critical theoretical gaps regarding the dynamic reconfiguration of monitoring-control relationships across expertise levels, the role of feedback topology in metacognitive development, and trade-offs between internal integration and external connectivity. Multiple viable developmental trajectories were identified. The taxonomy enables targeted, scenario-specific professional development interventions and generates testable predictions for advancing metacognition theory beyond primarily descriptive accounts.
1.2CYSep 18, 2025
Socratic Mind: Impact of a Novel GenAI-Powered Assessment Tool on Student Learning and Higher-Order ThinkingJeonghyun Lee, Jui-Tse Hung, Meryem Yilmaz Soylu et al.
This study examines the impact of Socratic Mind, a Generative Artificial Intelligence (GenAI) powered formative assessment tool that employs Socratic questioning to support student learning in a large, fully online undergraduate-level computing course. Employing a quasi-experimental, mixed-methods design, we investigated participants' engagement patterns, the influence of user experience on engagement, and impacts on both perceived and actual learning outcomes. Data were collected from the system logs, surveys on user experience and perceived engagement and learning gains, student reflections, and course performance data. Results indicated that participants consistently reported high levels of affective, behavioral, and cognitive engagement, and these were strongly linked to positive user experiences and perceived learning outcomes. Quantitative analysis further revealed that students who engaged with the GenAI tool experienced significant gains in their quiz scores compared to those who did not, particularly benefiting students with lower baseline achievement. Additionally, thematic analysis of qualitative feedback revealed substantial perceived improvements in higher-order thinking skills, including problem solving, critical thinking, and self-reflection. Our findings highlight the promise of AI-mediated dialogue in fostering deeper engagement and higher-order cognitive skills. As higher education institutions expand GenAI integration in curriculum, this dialogic, GenAI powered assessment tool can offer a scalable strategy to promote students' meaningful learning outcomes.