Is SpecVocab superseded?

SpecVocab (Speculative decoding): superseded — cited as a baseline and beaten by newer methods. 1 paper(s) critique it, 1 beat it on benchmarks — #64 of 151 most-superseded. Sub-problem: cluster led by FR-Spec. Newer alternatives in the same sub-problem include SlimSpec, EvoSpec, MicroSpec.

Speculative decoding

SpecVocab

Superseded baseline#64 of 151 most-superseded

Superseded — cited as a baseline and beaten by newer methods

1 papers critique it · 1 beat it on benchmarks

What papers say

Verbatim critique sentences, each from a paper that cites SpecVocab as a baseline.

The latter can become a noticeable bottleneck on GPUs because it involves such operations as global ranking, partial sorting, irregular indexing and gathering a context-dependent subset of weights, which are less efficient than dense matrix multiplication.

— SlimSpec: Low-Rank Draft LM-Head for Accelerated Speculative Decoding

Beaten on benchmarks

Head-to-head results where a newer method reports beating SpecVocab. Values are copied from the source paper's tables — verify against the cited paper.

SlimSpec beats SpecVocab
1.53 vs 1.46
Speedup · [Llama3.1-8B-Instruct, temperature 0, batch size 64]
SlimSpec: Low-Rank Draft LM-Head for Accelerated Speculative Decoding

What to use instead

Recent methods in the same sub-problem, not yet superseded in the knowledge base — arXiv benchmark leaders, not vetted production recommendations.