Method Drift›Parameter-efficient fine-tuning (LoRA family)
L2P
Parameter-efficient fine-tuning (LoRA family)
superseded — cited as a baseline and beaten by newer methods
1 papers critique it · 7 beat it on benchmarks
What papers say
Verbatim critique sentences, each from a paper that cites L2P as a baseline.
“a training trick is employed to mask out the classes not relevant to the current task. This trick contradicts the task-free OCL setting”
— Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation
Beaten on benchmarks
Head-to-head results where a newer method reports beating L2P. Values are copied from the source paper's tables — verify against the cited paper.
- Energy-Structured Low-Rank Adaptation for Continual Learning
E$^2$-LoRA beats L2P · Last-Acc [Office-Home]
88.25 vs 80.03
- Energy-Structured Low-Rank Adaptation for Continual Learning
E$^2$-LoRA beats L2P · Last-Acc [DomainNet]
69.63 vs 48.72
- Energy-Structured Low-Rank Adaptation for Continual Learning
E$^2$-LoRA beats L2P · Last-Acc [ImageNet-R 10-task]
82.77 vs 66.49
- Energy-Structured Low-Rank Adaptation for Continual Learning
E$^2$-LoRA beats L2P · Last-Acc [CIFAR-100 10-task]
92.13 vs 82.76
- Energy-Structured Low-Rank Adaptation for Continual Learning
E$^2$-LoRA beats L2P · Last-Acc [CUB-200 10-task]
89.77 vs 62.21
- Energy-Structured Low-Rank Adaptation for Continual Learning
E$^2$-LoRA beats L2P · Last-Acc [Cars-196 10-task]
75.82 vs 38.18
- Choice of PEFT Technique in Continual Learning: Prompt Tuning is Not All You Need
L2L beats L2P · Average Accuracy [memory-free continual learning]
95.75 vs 90.34
- Replay-Free Continual Low-Rank Adaptation with Dynamic Memory
DualLoRA+ beats L2P · ACC [5-Split ImageNet-R]
79.88 vs 61.60
- Replay-Free Continual Low-Rank Adaptation with Dynamic Memory
DualLoRA+ beats L2P · FT [5-Split ImageNet-R]
1.10 vs 5.36
- Replay-Free Continual Low-Rank Adaptation with Dynamic Memory
DualLoRA+ beats L2P · ACC [10-Split ImageNet-R]
81.17 vs 59.21
- Replay-Free Continual Low-Rank Adaptation with Dynamic Memory
DualLoRA+ beats L2P · FT [10-Split ImageNet-R]
2.04 vs 7.59
- Replay-Free Continual Low-Rank Adaptation with Dynamic Memory
DualLoRA+ beats L2P · ACC [20-Split ImageNet-R]
74.73 vs 56.36
Newer alternatives
Recent methods in the same sub-problem, not yet superseded in the knowledge base.
- G2LoRAG2LoRA: Gradient Orthogonal Low-Rank Adaptation Framework for Graph Continual Learning on Text-Attributed GraphsJun 1, 2026
- CoDyRATake Only What You Need: Rank Minimization as an Implicit Forgetting Regularizer in Continual LearningMay 27, 2026
- May 27, 2026
- May 26, 2026
- Beyond Feature FusionBeyond Feature Fusion: Contextual Bayesian PEFT for Multimodal Uncertainty EstimationApr 17, 2026
- Sequential Fine-Tuning with LoRASimple Recipe Works: Vision-Language-Action Models are Natural Continual Learners with Reinforcement LearningMar 12, 2026
- MAGE (Mixture and Aggregation of General LoRA and Expert LoRA)Continual-NExT: A Unified Comprehension And Generation Continual Learning FrameworkFeb 20, 2026
- Feb 19, 2026
- PS-LoRA (Parameter Stability LoRA)Resolving Conflicts in Lifelong Learning via Aligning Updates in SubspacesNov 28, 2025