Continual Learning for Adaptive AI Systems
This addresses the challenge of developing adaptive AI systems that can learn sequentially without forgetting, but it is incremental as it builds on existing continual learning methods.
The paper tackles the problem of catastrophic forgetting in neural networks by introducing Cluster-Aware Replay (CAR), a hybrid continual learning framework that integrates a replay buffer with an Inter-Cluster Fitness regularization loss, and initial experiments on Split CIFAR-10 show it better preserves earlier task performance compared to fine-tuning alone.
Continual learning the ability of a neural network to learn multiple sequential tasks without catastrophic forgetting remains a central challenge in developing adaptive artificial intelligence systems. While deep learning models achieve state-of-the-art performance across domains, they remain limited by overfitting and forgetting. This paper introduces Cluster-Aware Replay (CAR), a hybrid continual learning framework that integrates a small, class-balanced replay buffer with a regularization term based on Inter-Cluster Fitness (ICF) in the feature space. The ICF loss penalizes overlapping feature representations between new and previously learned tasks, encouraging geometric separation in the latent space and reducing interference. Using the standard five-task Split CIFAR-10 benchmark with a ResNet-18 backbone, initial experiments demonstrate that CAR better preserves earlier task performance compared to fine-tuning alone. These findings are preliminary but highlight feature-space regularization as a promising direction for mitigating catastrophic forgetting.