Is Budgeted LoRA superseded?

Budgeted LoRA (Parameter-efficient fine-tuning (LoRA family)): current frontier — recent, not yet superseded in the knowledge base. 0 paper(s) critique it, 0 beat it on benchmarks — not ranked as a superseded baseline. Sub-problem: cluster led by LoRA. Newer alternatives in the same sub-problem include Balanced LoRA, FedSmoothLoRA, FuRA, LoRA-Over, Hybrid-LoRA.

Parameter-efficient fine-tuning (LoRA family)

Budgeted LoRA

Budgeted LoRA: Distillation as Structured Compute Allocation for Efficient Inference

On the frontierfirst seen May 5, 2026

Current frontier — recent, not yet superseded in the knowledge base

0 papers critique it · 0 beat it on benchmarks

What to use instead

Recent methods in the same sub-problem, not yet superseded in the knowledge base — arXiv benchmark leaders, not vetted production recommendations.

Balanced LoRABalanced LoRA: Removing Parameter Invariance to Accelerate Convergence
May 29, 2026
FedSmoothLoRAFedSmoothLoRA: Toward Smoother and Faster Convergence in Federated Low-Rank Adaptation
May 28, 2026
FuRAFuRA: Full-Rank Parameter-Efficient Fine-Tuning with Spectral Preconditioning
May 19, 2026
LoRA-OverStrategic Over-Parameterization for Generalizable Low-Rank Adaptation
May 15, 2026
Hybrid-LoRAHybrid-LoRA: Bridging Full Fine-Tuning and Low-Rank Adaptation for Post-Training
May 12, 2026
HELLoRAHELLoRA: Hot Experts Layer-Level Low-Rank Adaptation for Mixture-of-Experts Models
May 11, 2026
AdaPaDAdaPaD: Adaptive Parallel Deflation for PEFT with Self-Correcting Rank Discovery
May 11, 2026
Queryable LoRAQueryable LoRA: Instruction-Regularized Routing Over Shared Low-Rank Update Atoms
May 8, 2026
Ortho-HydraOrtho-Hydra: Orthogonalized Experts for DiT LoRA
May 5, 2026
Budgeted LoRABudgeted LoRA: Distillation as Structured Compute Allocation for Efficient Inference
May 5, 2026
Echo-LoRAEcho-LoRA: Parameter-Efficient Fine-Tuning via Cross-Layer Representation Injection
May 5, 2026
RDP LoRARDP LoRA: Geometry-Driven Identification for Parameter-Efficient Adaptation in Large Language Models
Apr 21, 2026