Long-context / context-window extension
LoCoCo
LoCoCo: Dropping In Convolutions for Long Context Compression
Superseded baseline#31 of 53 most-superseded · first seen Jun 8, 2024
Superseded — cited as a baseline and beaten by newer methods
1 papers critique it · 1 beat it on benchmarks
What papers say
Verbatim critique sentences, each from a paper that cites LoCoCo as a baseline.
However, the increasing memory requirement for additional parameters is inevitable.
Beaten on benchmarks
Head-to-head results where a newer method reports beating LoCoCo. Values are copied from the source paper's tables — verify against the cited paper.
FreqKV beats LoCoCo
7.12 vs 8.08
Perplexity · [7B, 8K training]
FreqKV: Frequency Domain Key-Value Compression for Efficient Context Window Extension
What to use instead
Recent methods in the same sub-problem, not yet superseded in the knowledge base — arXiv benchmark leaders, not vetted production recommendations.
- May 14, 2026