Speculative decoding

PEARL

PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents

Superseded baseline#19 of 151 most-superseded · first seen May 23, 2023

Superseded — cited as a baseline and beaten by newer methods

4 papers critique it · 1 beat it on benchmarks

What papers say

Verbatim critique sentences, each from a paper that cites PEARL as a baseline.

However, unlike , none of these techniques focus on the data movement cost due to speculation. They require access to output probability distributions and are incompatible with approaches like n-gram speculation.
Utility-Driven Speculative Decoding for Mixture-of-Experts
Most similar to our work, pearl utilizes additional GPU resources to distribute the draft overhead. Our work differs by identifying and exploiting the potential of heterogeneous devices, while dynamically adapting the draft process based on available computational resources and draft outputs.
DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting
PEARL~liu2025pearl introduces a parallel framework allowing concurrent operation of target and draft models; however, it faces challenges handling resource constraints due to competition when both models are colocated.
PACER: Blockwise Pre-verification for Speculative Decoding with Adaptive Length
PEARL~liu_parallel_2024 is only applicable when the draft model's inference cost per step is in the same order as the target model's.
AdaEAGLE: Optimizing Speculative Decoding via Explicit Modeling of Adaptive Draft Structures

Beaten on benchmarks

Head-to-head results where a newer method reports beating PEARL. Values are copied from the source paper's tables — verify against the cited paper.

What to use instead

Recent methods in the same sub-problem, not yet superseded in the knowledge base — arXiv benchmark leaders, not vetted production recommendations.