GPU-ccelerated INT8 quantization for KV cache compression

Newer alternatives

Recent methods in the same sub-problem, not yet superseded in the knowledge base.

• ArborKVArborKV: Structure-Aware KV Cache Management for Scaling Tree-based LLM Reasoning
  May 21, 2026
• RDKVRDKV: Rate-Distortion Bit Allocation for Joint Eviction and Quantization of the KV Cache
  May 8, 2026
• EchoKVEchoKV: Efficient KV Cache Compression via Similarity-Based Reconstruction
  Mar 24, 2026
• VQKVVQKV: High-Fidelity and High-Ratio Cache Compression via Vector-Quantization
  Mar 17, 2026
• Self-Indexing KVCacheSelf-Indexing KVCache: Predicting Sparse Attention from Compressed Keys
  Mar 15, 2026
• KV-CoREKV-CoRE: Benchmarking Data-Dependent Low-Rank Compressibility of KV-Caches in LLMs
  Feb 5, 2026
• StiefAttentionDon't be so Stief! Learning KV Cache low-rank approximation over the Stiefel manifold
  Jan 29, 2026
• GPU-ccelerated INT8 quantization for KV cache compressionGPU-Accelerated INT8 Quantization for KV Cache Compression in Large Language Models
  Jan 8, 2026
• STA-AttentionUnlocking the Address Book: Dissecting the Sparse Semantic Structure of LLM Key-Value Caches via Sparse Autoencoders
  Dec 11, 2025
• SWANSWAN: Sparse Winnowed Attention for Reduced Inference Memory via Decompression-Free KV-Cache Compression
  Nov 24, 2025
• SALSSALS: Sparse Attention in Latent Space for KV cache Compression
  Oct 28, 2025
• OjaKVOjaKV: Context-Aware Online Low-Rank KV Cache Compression with Oja's Rule
  Sep 25, 2025