Is Ortho-Hydra superseded?

Ortho-Hydra (Parameter-efficient fine-tuning (LoRA family)): current frontier — recent, not yet superseded in the knowledge base. 0 paper(s) critique it, 0 beat it on benchmarks — not ranked as a superseded baseline. Sub-problem: cluster led by LoRA. Newer alternatives in the same sub-problem include Balanced LoRA, FedSmoothLoRA, FuRA, LoRA-Over, Hybrid-LoRA.

Method Drift›Parameter-efficient fine-tuning (LoRA family)

Tracked

Ortho-Hydra

Ortho-Hydra: Orthogonalized Experts for DiT LoRA

Parameter-efficient fine-tuning (LoRA family) · first seen May 5, 2026

current frontier — recent, not yet superseded in the knowledge base

0 papers critique it · 0 beat it on benchmarks

Newer alternatives

Recent methods in the same sub-problem, not yet superseded in the knowledge base.

Balanced LoRA Balanced LoRA: Removing Parameter Invariance to Accelerate Convergence
May 29, 2026
FedSmoothLoRA FedSmoothLoRA: Toward Smoother and Faster Convergence in Federated Low-Rank Adaptation
May 28, 2026
FuRA FuRA: Full-Rank Parameter-Efficient Fine-Tuning with Spectral Preconditioning
May 19, 2026
LoRA-Over Strategic Over-Parameterization for Generalizable Low-Rank Adaptation
May 15, 2026
Hybrid-LoRA Hybrid-LoRA: Bridging Full Fine-Tuning and Low-Rank Adaptation for Post-Training
May 12, 2026
HELLoRA HELLoRA: Hot Experts Layer-Level Low-Rank Adaptation for Mixture-of-Experts Models
May 11, 2026
AdaPaD AdaPaD: Adaptive Parallel Deflation for PEFT with Self-Correcting Rank Discovery
May 11, 2026
Queryable LoRA Queryable LoRA: Instruction-Regularized Routing Over Shared Low-Rank Update Atoms
May 8, 2026
Ortho-Hydra Ortho-Hydra: Orthogonalized Experts for DiT LoRA
May 5, 2026
Budgeted LoRA Budgeted LoRA: Distillation as Structured Compute Allocation for Efficient Inference
May 5, 2026
Echo-LoRA Echo-LoRA: Parameter-Efficient Fine-Tuning via Cross-Layer Representation Injection
May 5, 2026
RDP LoRA RDP LoRA: Geometry-Driven Identification for Parameter-Efficient Adaptation in Large Language Models
Apr 21, 2026