BadgeX: IoT-Enhanced Wearable Analytics Meets LLMs for Collaborative Learning
This addresses the challenge of making collaborative dynamics visible in educational settings, though it appears incremental as it combines existing technologies (IoT and LLMs) for a specific application.
The researchers tackled the problem of analyzing collaborative learning by developing BadgeX, a system that integrates wearable IoT devices with LLMs to capture and interpret multimodal sensor data from learners, with a pilot study showing it can generate plausible narrative analyses from sensor-derived features.
We present BadgeX, a novel system integrating lightweight wearable IoT devices (smart badges/smartphones) with Large Language Models (LLMs) to enable real-time collaborative learning analytics. The system captures multimodal sensor data (e.g., audio, image, motion, depth) from learners, processes it into structured features, and employs an LLM-driven framework to interpret these features, generating high-level insights grounded in learning theory. A pilot study demonstrated the system's capability to capture rich collaboration traces and for an LLM to produce plausible, theoretically coherent narrative analyses from sensor-derived features. BadgeX aims to lower deployment barriers, making complex collaborative dynamics visible and offering a pathway for real-time support in educational settings.