Is HetLoRA superseded?

HetLoRA (Parameter-efficient fine-tuning (LoRA family)): superseded — cited as a baseline and beaten by newer methods. 1 paper(s) critique it, 4 beat it on benchmarks — #41 of 1113 most-superseded. Sub-problem: cluster led by FFA-LoRA. Newer alternatives in the same sub-problem include Shift-Dependent Asymmetry, GLoRA, HiLoRA, FedRot-LoRA, ADF-LoRA.

Parameter-efficient fine-tuning (LoRA family)

HetLoRA

Superseded baseline#41 of 1,113 most-superseded

Superseded — cited as a baseline and beaten by newer methods

1 papers critique it · 4 beat it on benchmarks

What papers say

Verbatim critique sentences, each from a paper that cites HetLoRA as a baseline.

HetLoRA cho-etal-2024-heterogeneous and FlexLoRA bai2024federated allow clients to train varying-rank LoRA parameters, but the methods struggle in the presence of data heterogeneity and do not ensure exact aggregation.

— Ravan: Multi-Head Low-Rank Adaptation for Federated Fine-Tuning

Beaten on benchmarks

Head-to-head results where a newer method reports beating HetLoRA. Values are copied from the source paper's tables — verify against the cited paper.

FLoRA beats HetLoRA
41.72 vs 36.75
Accuracy · [GSM8K]
Preventing Rank Collapse in Federated Low-Rank Adaptation with Client Heterogeneity
HSplitLoRA beats HetLoRA
69.5 vs 62.2
BLEU · [GPT-2-L (hetero)]
HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models
GLoRA beats HetLoRA
34.95 vs 33.04
ROUGE-L · [Uniform rank distribution, unseen tasks]
Beyond Factor Aggregation: Gauge-Aware Low-Rank Server Representations for Federated LoRA

What to use instead

Recent methods in the same sub-problem, not yet superseded in the knowledge base — arXiv benchmark leaders, not vetted production recommendations.