KV-cache compression
CachePrune
CachePrune: Privacy-Aware and Fine-Grained KV Cache Sharing for Efficient LLM Inference
On the frontierfirst seen May 22, 2026
Current frontier — recent, not yet superseded in the knowledge base
0 papers critique it · 0 beat it on benchmarks
What to use instead
Recent methods in the same sub-problem, not yet superseded in the knowledge base — arXiv benchmark leaders, not vetted production recommendations.
- May 22, 2026
- Apr 28, 2026
- Predictive Multi-Tier Memory ManagementPredictive Multi-Tier Memory Management for KV Cache in Large-Scale GPU InferenceApr 19, 2026
- TableCacheTableCache: Primary Foreign Key Guided KV Cache Precomputation for Low Latency Text-to-SQLJan 13, 2026
- Jan 5, 2026
- SemShareKVSemShareKV: Efficient KVCache Sharing for Semantically Similar Prompts via Token-Level LSH MatchingSep 29, 2025