Mohammad Fahim Abrar

Shayla Sharmin, Mohammad Fahim Abrar, Roghayeh Leila Barmaki

AI-assisted feedback research has shown that micro-level feedback features, such as concrete elaboration, affective language, and response length, are associated with learning outcomes. Existing studies have primarily examined these features using session- or task-level measures. We examine how feedback provided in one user-AI interaction is associated with student confusion and understanding in the immediately following interaction in a naturalistic tutoring setting. We focus on three micro-level features of AI feedback: concrete elaboration (analogies, comparison-based explanations, or worked examples), affective language (encouragement, empathy, or apology), and response length. We analyzed 16,851 conversational user-AI interactions from the StudyChat dataset, a naturalistic record of student interactions with an LLM tutor in an undergraduate AI course, and identified 1,718 cases in which students expressed confusion and continued to a subsequent interaction. Using chi-square tests and Generalized Estimating Equations (GEE), we found that concrete elaboration was associated with higher understanding and lower re-confusion in the student's next interaction. Empathetic language showed no significant association with either outcome, while longer responses were independently associated with lower understanding. These findings highlight the value of examining feedback across consecutive user-AI interactions and suggest that concrete elaboration may play an important role in supporting immediate student understanding.

Shayla Sharmin, Mohammad Fahim Abrar, Mohammad Al-Ratrout et al.

Problem posing is a valuable learning activity in computing education, encouraging learners to actively construct, refine, and reflect on problems rather than simply solving them. This experience report presents the design and pilot deployment of two LLM-powered scaffolding systems for supporting problem posing across two computational scenarios with different levels of task openness. Both systems assessed student-generated problems using Bloom's Taxonomy-based criteria and applied the same assessment framework, differing only in output modality: one provided guiding questions (Indirect scaffolding), while the other offered worked examples (Direct scaffolding). We conducted a within-subjects, counterbalanced pilot study with 20 graduate students and collected problem-quality ratings, user-experience surveys, and post-session interviews. Our deployment showed that both systems supported problem refinement in complementary ways, each offering distinct benefits. Direct scaffolding produced greater immediate improvements, while interviews showed that participants valued Indirect scaffolding for promoting deeper reflection on their own problem design. Based on these findings, we suggest sequencing the two modalities by beginning with Indirect scaffolding to promote reflection, then shifting to Direct scaffolding when learners become stuck. These lessons offer an initial practical strategy for integrating LLM-based scaffolding into computing classrooms.

Shayla Sharmin, Mohammad Al-Ratrout, Mohammad Fahim Abrar et al.

We examine educational YouTube videos through multimodal metadata, such as transcripts, titles, thumbnails, and viewer comments, to investigate how ChatGPT is framed across creator groups and how those framings relate to audience response and platform reach. Little is known about how large language models are presented to learners in informal, creator-driven public discourse. Following PRISMA, we selected 52 videos for analysis. We identified three structurally distinct discourse groups: (G1) videos that positioned ChatGPT as a conceptual scaffold for thinking, (G2) videos oriented toward retrieval practice and skill-building, and (G3) videos that framed ChatGPT as a tool for output generation. Epistemic Network Analysis revealed statistically significant group differences with large effect sizes. Multimodal metadata consistently reflected these distinctions across transcript discourse, titles, and thumbnails. Viewers of learning-oriented content described ChatGPT as a thinking partner or tutor, whereas viewers of output-oriented content raised concerns about over-reliance, surface-level learning, and cognitive offloading. G3 achieved comparable platform reach to G2, yet with substantially weaker learning-oriented framing. This may suggest that output-oriented content competes for visibility despite lower pedagogical depth. These findings reveal a structural tension in self-directed AI learning: content that prioritizes quick outputs reaches far more learners than content that promotes deep engagement. This gap raises critical questions about whose vision of AI literacy scales and what learners are actually left with.