sd.npu

Newer alternatives

Recent methods in the same sub-problem, not yet superseded in the knowledge base.

• SpecKVSpecKV: Adaptive Speculative Decoding with Compression-Aware Gamma Selection
  May 4, 2026
• component-aware self-speculative decodingComponent-Aware Self-Speculative Decoding in Hybrid Language Models
  May 1, 2026
• FASERFASER: Fine-Grained Phase Management for Speculative Decoding in Dynamic LLM Serving
  Apr 22, 2026
• ConfLayersConfLayers: Adaptive Confidence-based Layer Skipping for Self-Speculative Decoding
  Apr 16, 2026
• GooseGoose: Anisotropic Speculation Trees for Training-Free Speculative Decoding
  Apr 2, 2026
• greedy multi-path block verification (GBV)Greedy Multi-Path Block Verification for Faster Decoding in Speculative Sampling
  Feb 18, 2026
• SDFPSDFP: Speculative Decoding with FIT-Pruned Models for Training-Free and Plug-and-Play LLM Acceleration
  Feb 5, 2026
• PacerPACER: Blockwise Pre-verification for Speculative Decoding with Adaptive Length
  Feb 1, 2026
• CAS-Spec (Cascade Adaptive Self-Speculative Decoding)CAS-Spec: Cascade Adaptive Self-Speculative Decoding for On-the-Fly Lossless Inference Acceleration of LLMs
  Oct 30, 2025
• FastVLMFastVLM: Self-Speculative Decoding for Fast Vision-Language Model Inference
  Oct 26, 2025
• sd.npuAccelerating Mobile Language Model via Speculative Decoding and NPU-Coordinated Execution
  Oct 17, 2025
• HiSpecHiSpec: Hierarchical Speculative Decoding for LLMs
  Oct 1, 2025