Method Drift›Speculative decoding
Hydra
Hydra: Sequentially-Dependent Draft Heads for Medusa DecodingSpeculative decoding · first seen Feb 7, 2024
superseded — cited as a baseline and beaten by newer methods
1 papers critique it · 4 beat it on benchmarks
What papers say
Verbatim critique sentences, each from a paper that cites Hydra as a baseline.
“However, these methods are still primarily based on token-level supervised objectives. Such objectives improve local next-token prediction, but speculative utility is inherently window-level and prefix-sensitive: once the accepted prefix is truncated due to an early mismatch, the remaining drafted tokens in the speculative window are invalidated.”
— Performance-Driven Policy Optimization for Speculative Decoding with Adaptive Windowing
Beaten on benchmarks
Head-to-head results where a newer method reports beating Hydra. Values are copied from the source paper's tables — verify against the cited paper.
- ECHO: Elastic Speculative Decoding with Sparse Gating for High-Concurrency Scenarios
ECHO beats Hydra · Avg. Speedup [Vicuna-13B]
5.25 vs 2.46
- DART: Diffusion-Inspired Speculative Decoding for Fast LLM Inference
DART beats Hydra · Speedup [L2 7B Temperature=0]
2.85 vs 2.66
- DREAM: Drafting with Refined Target Features and Entropy-Adaptive Cross-Attention Fusion for Multimodal Speculative Decoding
DREAM beats Hydra · S (speedup) [LLaVA-v1.6 Vicuna-7B, Temperature = 0]
2.23 vs 1.56
- DREAM-S: Speculative Decoding with Searchable Drafting and Target-Aware Refinement for Multimodal Generation
DREAM-S beats Hydra · Average speedup ratio (S) [LLaVA-v1.6-Vicuna-7B, Temperature=0]
2.35 vs 1.56
- DREAM-S: Speculative Decoding with Searchable Drafting and Target-Aware Refinement for Multimodal Generation
DREAM-S beats Hydra · Average speedup ratio (S) [LLaVA-v1.6-Vicuna-13B, Temperature=0]
3.16 vs 1.87
Newer alternatives
Recent methods in the same sub-problem, not yet superseded in the knowledge base.
- DREAM-SDREAM-S: Speculative Decoding with Searchable Drafting and Target-Aware Refinement for Multimodal GenerationMay 30, 2026
- May 14, 2026
- SpecForgeSpecForge: A Flexible and Efficient Open-Source Training Framework for Speculative DecodingMar 19, 2026
- Mar 13, 2026
- Feb 17, 2026
- Oct 22, 2025
- Oct 22, 2025
- Oct 17, 2025
- Draft, Verify, & Improve (DVI)Draft, Verify, and Improve: Toward Training-Aware Speculative DecodingOct 6, 2025
- FastGRPOFastGRPO: Accelerating Policy Optimization via Concurrency-aware Speculative Decoding and Online Draft LearningSep 26, 2025