FLy (Training-Free Loosely Speculative Decoding)

Newer alternatives

Recent methods in the same sub-problem, not yet superseded in the knowledge base.

• Collaborative Speculative Decoding (CoSpec)Beyond the Target: From Imitation to Collaboration in Speculative Decoding
  May 24, 2026
• ToolSpecToolSpec: Accelerating Tool Calling via Schema-Aware and Retrieval-Augmented Speculative Decoding
  Apr 15, 2026
• QuasarQuasar: Quantized Self-Speculative Acceleration for Rapid Inference via Memory-Efficient Verification
  Mar 2, 2026
• FLy (Training-Free Loosely Speculative Decoding)Training-Free Loosely Speculative Decoding: Accepting Semantically Correct Drafts Beyond Exact Match
  Nov 28, 2025
• Pivot-Aware Speculative DecodingReject Only Critical Tokens: Pivot-Aware Speculative Decoding
  Nov 1, 2025
• ReSpecReSpec: Towards Optimizing Speculative Decoding in Reinforcement Learning Systems
  Oct 30, 2025
• Not-a-BanditNot-a-Bandit: Provably No-Regret Drafter Selection in Speculative Decoding for LLMs
  Oct 22, 2025
• OWLOWL: Overcoming Window Length-Dependence in Speculative Decoding for Long-Context Inputs
  Oct 8, 2025
• Group Tree Optimization (GTO)Bridging Draft Policy Misalignment: Group Tree Optimization for Speculative Decoding
  Sep 26, 2025
• SpiffySpiffy: Multiplying Diffusion LLM Acceleration via Lossless Speculative Decoding
  Sep 22, 2025