Method DriftLong-context / context-window extension

Tracked

HoPE

HoPE: A Novel Positional Encoding Without Long-Term Decay for Enhanced Context Awareness and Extrapolation

Long-context / context-window extension · first seen Oct 28, 2024

present, but with little supersession signal in the knowledge base

0 papers critique it · 0 beat it on benchmarks

Newer alternatives

Recent methods in the same sub-problem, not yet superseded in the knowledge base.