Long-context / context-window extension

LongLLMLingua

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Superseded baseline#32 of 53 most-superseded · first seen Oct 10, 2023

Superseded — cited as a baseline and beaten by newer methods

1 papers critique it · 1 beat it on benchmarks

What papers say

Verbatim critique sentences, each from a paper that cites LongLLMLingua as a baseline.

the compressed length still grows linearly with the original context length. This fails to fundamentally alter the asymptotic order of spatiotemporal complexity and can only improve efficiency by reducing constant factors
CoMeT: Collaborative Memory Transformer for Efficient Long Context Modeling

Beaten on benchmarks

Head-to-head results where a newer method reports beating LongLLMLingua. Values are copied from the source paper's tables — verify against the cited paper.

What to use instead

Recent methods in the same sub-problem, not yet superseded in the knowledge base — arXiv benchmark leaders, not vetted production recommendations.