Live Knowledge Tracing: Real-Time Adaptation using Tabular Foundation Models
This addresses the need for efficient and adaptive knowledge tracing in educational technology, representing a new paradigm rather than an incremental improvement.
The paper tackles the problem of slow training and overfitting in deep knowledge tracing models by introducing a real-time approach using tabular foundation models, achieving competitive predictive performance with up to 273x speedups.
Deep knowledge tracing models have achieved significant breakthroughs in modeling student learning trajectories. However, these architectures require substantial training time and are prone to overfitting on datasets with short sequences. In this paper, we explore a new paradigm for knowledge tracing by leveraging tabular foundation models (TFMs). Unlike traditional methods that require offline training on a fixed training set, our approach performs real-time ''live'' knowledge tracing in an online way. The core of our method lies in a two-way attention mechanism: while attention knowledge tracing models only attend across earlier time steps, TFMs simultaneously attend across both time steps and interactions of other students in the training set. They align testing sequences with relevant training sequences at inference time, therefore skipping the training step entirely. We demonstrate, using several datasets of increasing size, that our method achieves competitive predictive performance with up to 273x speedups, in a setting where more student interactions are observed over time.