Sequoia

“methods that scale better with more draft tokens rely on static tree structures that may not be optimal for every setting, as they require tree structure optimization for every change in the text domain, generation parameters, and the hardware setup.”

“However, fixed patterns usually struggle to generalize to diverse query distributions, resulting in a relatively low acceptance rate as tree size grows.”

“Under Sequoia's positional acceptance assumption, the probability of accepting a token depends only on its rank among siblings---all sources share a single acceptance vector regardless of origin.”

“Tree-based verification (Sequoia, SpecExec) boosts acceptance but often increases compute”