Speculative decoding
SLED
SLED: A Speculative LLM Decoding Framework for Efficient Edge Serving
Superseded baseline#71 of 151 most-superseded · first seen Jun 11, 2025
Cited as a baseline — critiqued by newer work, not yet beaten on a benchmark here
2 papers critique it · 0 beat it on benchmarks
What papers say
Verbatim critique sentences, each from a paper that cites SLED as a baseline.
existing edge SD systems typically adopt simple batching policies, e.g., static batching in SLED
“Similarly, SLED li2025sled focuses on multi-client throughput but fails to provide deep latency masking for individual users.”
What to use instead
Recent methods in the same sub-problem, not yet superseded in the knowledge base — arXiv benchmark leaders, not vetted production recommendations.