Method Drift›Mixture-of-experts routing
Tracked
Soft-MoE
From Sparse to Soft Mixtures of ExpertsMixture-of-experts routing · first seen Aug 2, 2023
present, but with little supersession signal in the knowledge base
0 papers critique it · 0 beat it on benchmarks