Is BigBird superseded?

Q: Is BigBird superseded?

BigBird (Long-context / context-window extension): superseded — cited as a baseline and beaten by newer methods. 0 paper(s) critique it, 1 beat it on benchmarks — #39 of 53 most-superseded. Sub-problem: cluster led by Ring Attention.

Long-context / context-window extension

BigBird

Big Bird: Transformers for Longer Sequences

Superseded baseline#39 of 53 most-superseded · first seen Jul 28, 2020

Superseded — cited as a baseline and beaten by newer methods

0 papers critique it · 1 beat it on benchmarks