Method Drift›Long-context / context-window extension
Tracked
ΠAttention
Attention: Marginal Probability is All You Need?Long-context / context-window extension · first seen Apr 7, 2023
present, but with little supersession signal in the knowledge base
0 papers critique it · 0 beat it on benchmarks