Method Drift›Long-context / context-window extension
Superseded baseline#31 of 53 most-superseded
LoCoCo
LoCoCo: Dropping In Convolutions for Long Context CompressionLong-context / context-window extension · first seen Jun 8, 2024
superseded — cited as a baseline and beaten by newer methods
1 papers critique it · 1 beat it on benchmarks
What papers say
Verbatim critique sentences, each from a paper that cites LoCoCo as a baseline.
“However, the increasing memory requirement for additional parameters is inevitable.”
— FreqKV: Frequency Domain Key-Value Compression for Efficient Context Window Extension
Beaten on benchmarks
Head-to-head results where a newer method reports beating LoCoCo. Values are copied from the source paper's tables — verify against the cited paper.
- FreqKV: Frequency Domain Key-Value Compression for Efficient Context Window Extension
FreqKV beats LoCoCo · Perplexity [7B, 8K training]
7.45 vs 8.15
Newer alternatives
Recent methods in the same sub-problem, not yet superseded in the knowledge base.
- May 14, 2026