KVServe

Newer alternatives

Recent methods in the same sub-problem, not yet superseded in the knowledge base.

• SpectrumKVSpectrumKV: Per-Token Mixed-Precision KV Cache Transfer for Prefill-Decode Disaggregated LLM Serving
  Jun 7, 2026
• Hurwitz Quaternion Multiplicative Quantization (HQMQ)Hurwitz Quaternion Multiplicative Quantization for KV Cache Compression
  May 26, 2026
• OSCAROSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization
  May 18, 2026
• OScaROSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization
  May 18, 2026
• TriAxialKVTriAxialKV: Toward Extreme Low-Precision KV-Cache Quantization for Agentic Inference Tasks
  May 16, 2026
• KVServeKVServe: Service-Aware KV Cache Compression for Communication-Efficient Disaggregated LLM Serving
  May 13, 2026
• WindowQuantWindowQuant: Mixed-Precision KV Cache Quantization based on Window-Level Similarity for VLMs Inference Optimization
  May 4, 2026
• SAW-INT4SAW-INT4: System-Aware 4-Bit KV-Cache Quantization for Real-World LLM Serving
  Apr 21, 2026
• eOptShrinkQeOptShrinkQ: Near-Lossless KV Cache Compression Through Optimal Spectral Denoising and Quantization
  Apr 6, 2026
• OCTOPUSOctopus: Enhancing CXL Memory Pods via Sparse Topology
  Apr 3, 2026
• IsoQuantIsoQuant: Hardware-Aligned SO(4) Isoclinic Rotations for LLM KV Cache Compression
  Mar 30, 2026
• TurboAngleTurboAngle: Near-Lossless KV Cache Compression via Uniform Angle Quantization
  Mar 29, 2026