Is HELLoRA superseded?

HELLoRA (Mixture-of-experts routing): current frontier — recent, not yet superseded in the knowledge base. 0 paper(s) critique it, 0 beat it on benchmarks — not ranked as a superseded baseline. Sub-problem: cluster led by HydraLoRA. Newer alternatives in the same sub-problem include PARAMΔ Integration into Upcycled MoE, MEMIT-like framework for MoE, HELLoRA, SDG-MoE, Marco-MoE.

Method Drift›Mixture-of-experts routing

Tracked

HELLoRA

HELLoRA: Hot Experts Layer-Level Low-Rank Adaptation for Mixture-of-Experts Models

Mixture-of-experts routing · first seen May 11, 2026

current frontier — recent, not yet superseded in the knowledge base

0 papers critique it · 0 beat it on benchmarks

Newer alternatives

Recent methods in the same sub-problem, not yet superseded in the knowledge base.

PARAMΔ Integration into Upcycled MoE A Data-Efficient Path to Multilingual LLMs: Language Expansion via Post-training PARAM$Δ$ Integration into Upcycled MoE
May 18, 2026
MEMIT-like framework for MoE Scalable Knowledge Editing for Mixture-of-Experts LLMs via Tensor-Structured Updates
May 15, 2026
HELLoRA HELLoRA: Hot Experts Layer-Level Low-Rank Adaptation for Mixture-of-Experts Models
May 11, 2026
SDG-MoE SDG-MoE: Signed Debate Graph Mixture-of-Experts
May 8, 2026
Marco-MoE Marco-MoE: Open Multilingual Mixture-of-Expert Language Models with Efficient Upcycling
Apr 28, 2026
CoGR-MoE CoGR-MoE: Concept-Guided Expert Routing with Consistent Selection and Flexible Reasoning for Visual Question Answering
Apr 18, 2026
FourierMoE FourierMoE: Fourier Mixture-of-Experts Adaptation of Large Language Models
Apr 2, 2026
On Token's Dilemma On Token's Dilemma: Dynamic MoE with Drift-Aware Token Assignment for Continual Learning of Large Vision Language Models
Mar 29, 2026
Mixture-of-Experts (MoE) and Mixture-of-Linear-Experts (MoLE) architectures for MLIPs Scaling Machine Learning Interatomic Potentials with Mixtures of Experts
Mar 9, 2026
NeuronMoE NeuronMoE: Neuron-Guided Mixture-of-Experts for Efficient Multilingual LLM Extension
Mar 5, 2026
SD-MoE SD-MoE: Spectral Decomposition for Effective Expert Specialization
Feb 13, 2026
Multiscale Interaction Mixture of Experts (MI-MoE)Topology-Aware Multiscale Mixture of Experts for Efficient Molecular Property Prediction
Jan 19, 2026