Method Drift›KV-cache compression
Superseded baseline#58 of 234 most-superseded
Mooncake
Mooncake: A KVCache-centric Disaggregated Architecture for LLM ServingKV-cache compression · first seen Jun 24, 2024
superseded — cited as a baseline and beaten by newer methods
2 papers critique it · 1 beat it on benchmarks
What papers say
Verbatim critique sentences, each from a paper that cites Mooncake as a baseline.
“Mooncake uses reactive placement---blocks are placed based on current utilization---while our Bayesian predictor proactively positions blocks based on predicted reuse probability, achieving 70--84% hit rates vs. Mooncake's reported 65--80%”
— Predictive Multi-Tier Memory Management for KV Cache in Large-Scale GPU Inference“their approaches are restricted to sharing in the layer or text segment within adjacent layers or the same LLM, limiting the broader applicability”
— SemShareKV: Efficient KVCache Sharing for Semantically Similar Prompts via Token-Level LSH Matching
Beaten on benchmarks
Head-to-head results where a newer method reports beating Mooncake. Values are copied from the source paper's tables — verify against the cited paper.
- FlowKV: A Disaggregated Inference Framework with Low-Latency KV Cache Transfer and Load-Aware Scheduling
FlowKV beats Mooncake · KV Cache transfer latency (seconds) [Single Machine]
0.0044 vs 0.3010
- FlowKV: A Disaggregated Inference Framework with Low-Latency KV Cache Transfer and Load-Aware Scheduling
FlowKV beats Mooncake · KV Cache transfer latency (seconds) [Multiple Heterogeneous Machines]
0.0080 vs 0.3418
Newer alternatives
Recent methods in the same sub-problem, not yet superseded in the knowledge base.
- May 22, 2026
- Apr 28, 2026
- Predictive Multi-Tier Memory ManagementPredictive Multi-Tier Memory Management for KV Cache in Large-Scale GPU InferenceApr 19, 2026
- TableCacheTableCache: Primary Foreign Key Guided KV Cache Precomputation for Low Latency Text-to-SQLJan 13, 2026
- Jan 5, 2026
- SemShareKVSemShareKV: Efficient KVCache Sharing for Semantically Similar Prompts via Token-Level LSH MatchingSep 29, 2025