Pilot Study on Generative AI and Critical Thinking in Higher Education Classrooms
It addresses the underexplored issue of how students critically assess Generative AI in education, though it is incremental as a pilot study laying groundwork for future research.
This pilot study tackled the problem of students' critical thinking when evaluating Generative AI outputs in higher education, finding initial insights into their ability to analyze and critique AI-generated content.
Generative AI (GAI) tools have seen rapid adoption in educational settings, yet their role in fostering critical thinking remains underexplored. While previous studies have examined GAI as a tutor for specific lessons or as a tool for completing assignments, few have addressed how students critically evaluate the accuracy and appropriateness of GAI-generated responses. This pilot study investigates students' ability to apply structured critical thinking when assessing Generative AI outputs in introductory Computational and Data Science courses. Given that GAI tools often produce contextually flawed or factually incorrect answers, we designed learning activities that require students to analyze, critique, and revise AI-generated solutions. Our findings offer initial insights into students' ability to engage critically with GAI content and lay the groundwork for more comprehensive studies in future semesters.