Predictive Multi-Tier Memory Management

Newer alternatives

Recent methods in the same sub-problem, not yet superseded in the knowledge base.

• CachePruneCachePrune: Privacy-Aware and Fine-Grained KV Cache Sharing for Efficient LLM Inference
  May 22, 2026
• CacheFlowCacheFlow: Efficient LLM Serving with 3D-Parallel KV Cache Restoration
  Apr 28, 2026
• Predictive Multi-Tier Memory ManagementPredictive Multi-Tier Memory Management for KV Cache in Large-Scale GPU Inference
  Apr 19, 2026
• TableCacheTableCache: Primary Foreign Key Guided KV Cache Precomputation for Low Latency Text-to-SQL
  Jan 13, 2026
• OrbitFlowOrbitFlow: SLO-Aware Long-Context LLM Serving with Fine-Grained KV Cache Reconfiguration
  Jan 5, 2026
• SemShareKVSemShareKV: Efficient KVCache Sharing for Semantically Similar Prompts via Token-Level LSH Matching
  Sep 29, 2025