Method Drift›Mixture-of-experts routing
RICE
Mixture-of-experts routing
superseded — cited as a baseline and beaten by newer methods
2 papers critique it · 1 beat it on benchmarks
What papers say
Verbatim critique sentences, each from a paper that cites RICE as a baseline.
“Yet RICE has drawbacks: it relies on the presence of an explicit $<\!think\!>$ token, making it unsuitable in other settings; it only amplifies experts”
— Steering MoE LLMs via Expert (De)Activation“RICE~wang2025two recently introduces a steering method that focuses on thinking experts. However, this approach is currently limited to extremely large reasoning models, such as DeepSeek-R1~deepseekai2025deepseekr1incentivizingreasoningcapability and Qwen3-235B~qwen3technicalreport.”
— Do Domain-specific Experts exist in MoE-based LLMs?
Beaten on benchmarks
Head-to-head results where a newer method reports beating RICE. Values are copied from the source paper's tables — verify against the cited paper.
- Do Domain-specific Experts exist in MoE-based LLMs?
DeepSeekMoE beats RICE · Average [Qwen3-30B-Instruct]
83.3 vs 82.4
- Do Domain-specific Experts exist in MoE-based LLMs?
DeepSeekMoE beats RICE · Average [GPT-OSS-120B]
84.4 vs 82.1
- Do Domain-specific Experts exist in MoE-based LLMs?
DeepSeekMoE beats RICE · Average [Qwen3-30B-Thinking]
69.6 vs 66.9
- Do Domain-specific Experts exist in MoE-based LLMs?
DeepSeekMoE beats RICE · Average [GPT-OSS-20B]
67.1 vs 61.0
- Do Domain-specific Experts exist in MoE-based LLMs?
DeepSeekMoE beats RICE · AIME 24 [Qwen3-30B-Instruct]
70.0 vs 63.3
- Do Domain-specific Experts exist in MoE-based LLMs?
DeepSeekMoE beats RICE · AIME 25 [Qwen3-30B-Instruct]
60.0 vs 46.7
- Do Domain-specific Experts exist in MoE-based LLMs?
DeepSeekMoE beats RICE · AIME 24 [GPT-OSS-20B]
77.3 vs 56.7
- Do Domain-specific Experts exist in MoE-based LLMs?
DeepSeekMoE beats RICE · AIME 25 [GPT-OSS-20B]
78.6 vs 46.7
Newer alternatives
Recent methods in the same sub-problem, not yet superseded in the knowledge base.
- PADDPADD: Path-Aligned Decompression Distillation for Non-Router Teacher to Guide MoE Student LearningJun 9, 2026
- May 30, 2026
- May 29, 2026
- May 1, 2026
- Apr 30, 2026
- Feb 9, 2026
- SocialNav-MoESocialNav-MoE: A Mixture-of-Experts Vision Language Model for Socially Compliant Navigation with Reinforcement Fine-TuningDec 15, 2025
- OrdMoEOrdMoE: Preference Alignment via Hierarchical Expert Group Ranking in Multimodal Mixture-of-Experts LLMsNov 24, 2025
- router-aware approach to optimize importance sampling weightsTowards Stable and Effective Reinforcement Learning for Mixture-of-ExpertsOct 27, 2025
- Mix- and MoE-DPOMix- and MoE-DPO: A Variational Inference Approach to Direct Preference OptimizationOct 9, 2025