KV-cache compression
FastV
Superseded baseline#42 of 234 most-superseded
Superseded — cited as a baseline and beaten by newer methods
2 papers critique it · 2 beat it on benchmarks
What papers say
Verbatim critique sentences, each from a paper that cites FastV as a baseline.
However, most existing methods depend on query-derived text tokens to compute attention scores and initiate compression, inevitably causing response delays in online scenarios.
“FastV, though training-free, prunes vision tokens without cross-modality guidance, yielding inconsistent results across models and benchmarks.”
Beaten on benchmarks
Head-to-head results where a newer method reports beating FastV. Values are copied from the source paper's tables — verify against the cited paper.
KVCapsule beats FastV
1.01 vs 0.08
HAE-LLaVA (Ours, Retain, 192) beats FastV
61.7 vs 52.7
GQA · [LLaVA-1.5-7B with 192 visual tokens retained]
Hierarchical Adaptive Eviction for KV Cache Management in Multimodal Language Models
What to use instead
Recent methods in the same sub-problem, not yet superseded in the knowledge base — arXiv benchmark leaders, not vetted production recommendations.
- May 21, 2026
- KVCapsuleKVCapsule: Efficient Sequential KV Cache Compression for Vision-Language Models with Asymmetric RedundancyMay 14, 2026
- Decoupled Streaming Cache (DSCache)Decouple and Cache: KV Cache Construction for Streaming Video UnderstandingMay 3, 2026
- May 1, 2026
- Hierarchical Adaptive Eviction (HAE)Hierarchical Adaptive Eviction for KV Cache Management in Multimodal Language ModelsFeb 2, 2026
- Dec 13, 2025
- StreamKVStreamKV: Streaming Video Question-Answering with Segment-based KV Cache Retrieval and CompressionNov 10, 2025