Method Drift›Long-context / context-window extension
Superseded baseline#32 of 53 most-superseded
LongLLMLingua
LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt CompressionLong-context / context-window extension · first seen Oct 10, 2023
superseded — cited as a baseline and beaten by newer methods
1 papers critique it · 1 beat it on benchmarks
What papers say
Verbatim critique sentences, each from a paper that cites LongLLMLingua as a baseline.
“the compressed length still grows linearly with the original context length. This fails to fundamentally alter the asymptotic order of spatiotemporal complexity and can only improve efficiency by reducing constant factors”
— CoMeT: Collaborative Memory Transformer for Efficient Long Context Modeling
Beaten on benchmarks
Head-to-head results where a newer method reports beating LongLLMLingua. Values are copied from the source paper's tables — verify against the cited paper.
- CoMeT: Collaborative Memory Transformer for Efficient Long Context Modeling
CoMeT beats LongLLMLingua · Avg [SCROLLS benchmark, 3k memory budget]
40.10 vs 37.36
Newer alternatives
Recent methods in the same sub-problem, not yet superseded in the knowledge base.