KV-cache compression

TurboRAG

Superseded baseline#35 of 234 most-superseded

Superseded — cited as a baseline and beaten by newer methods

3 papers critique it · 2 beat it on benchmarks

What papers say

Verbatim critique sentences, each from a paper that cites TurboRAG as a baseline.

block-based methods like PromptCache~Gim2023PromptCM, TurboRAG~lu2024turborag, and BlockAttention~ma2024block ignore inter-block dependencies, causing performance degradation
TableCache: Primary Foreign Key Guided KV Cache Precomputation for Low Latency Text-to-SQL
However, it still falls short in effectively reconnecting reused caches.
KVLink: Accelerating Large Language Models via Efficient KV Cache Reuse
Reuse strategies effective for agent-side generation can be decision-non-invariant for judges, revealing a failure mode overlooked by prior work.
When KV Cache Reuse Fails in Multi-Agent Systems: Cross-Candidate Interaction is Crucial for LLM Judges

Beaten on benchmarks

Head-to-head results where a newer method reports beating TurboRAG. Values are copied from the source paper's tables — verify against the cited paper.

What to use instead

Recent methods in the same sub-problem, not yet superseded in the knowledge base — arXiv benchmark leaders, not vetted production recommendations.