Exploring the Use of ChatGPT for a Systematic Literature Review: a Design-Based Research
This addresses the problem of automating literature reviews for researchers, though it is incremental as it builds on existing uses of ChatGPT in research.
The study investigated whether ChatGPT can perform systematic literature reviews (SLRs) by comparing its results on 33 papers to a human-conducted SLR, finding that it can conduct SLRs but requires detailed prompts and has limitations.
ChatGPT has been used in several educational contexts,including learning, teaching and research. It also has potential to conduct the systematic literature review (SLR). However, there are limited empirical studies on how to use ChatGPT in conducting a SLR. Based on a SLR published,this study used ChatGPT to conduct a SLR of the same 33 papers in a design-based approach, to see what the differences are by comparing the reviews' results,and to answer: To what extent can ChatGPT conduct SLR? What strategies can human researchers utilize to structure prompts for ChatGPT that enhance the reliability and validity of a SLR? This study found that ChatGPT could conduct a SLR. It needs detailed and accurate prompts to analyze the literature. It also has limitations. Guiding principles are summarized from this study for researchers to follow when they need to conduct SLRs using ChatGPT.