Interactive Evidence Maps for Visualizing and Understanding Systematic Reviews
For researchers conducting systematic reviews, this tool improves transparency and pattern detection, but the contribution is incremental as it applies existing LLM and visualization techniques to a specific domain.
The authors introduce interactive evidence maps, a visualization tool that uses large language models to structure systematic review data into explorable knowledge maps, enhancing transparency and revealing patterns not easily detected in narrative summaries. Demonstrated on a scoping review of pedagogical agents in K-12 education, the tool complements traditional syntheses by supporting exploratory analysis.
Systematic reviews provide comprehensive syntheses of research fields. As a result, systematic reviews often emphasize synthesizing across the large bodies of literature rather than just describing the studies from which the conclusions were drawn. This risks an incomplete description of the sample - encouraging overgeneralization of the findings, obscuring connections between existing work, or overshadowing gaps in the literature. To address this challenge, we introduce interactive evidence maps; an accessible visualization tool that enables researchers to explore, filter, and analyze review data dynamically. Our approach leverages large language models to extract topic models that structure heterogeneous review data into an interactive, explorable knowledge map that supports deeper inspection beyond static tables and figures. We demonstrate the usefulness of interactive evidence maps using data from a published scoping review of pedagogical agents in K-12 education, and compare the results of the evidence map to those reported in the scoping review. Results show that interactive evidence maps complement traditional syntheses by enhancing transparency, supporting exploratory analysis, and revealing patterns and gaps that may not be easy to detect through narrative summaries alone.