我们需要注意力机制吗？用于 NLP 的线性 RNN

Sasha Rush surveys linear RNNs and state space models as replacements for attention in transformer-style models, in a talk for MLSys. It covers the foundational preliminaries and predates Mamba.

Why HN likes it: HN commenters recommend it for building intuition about state space models and the tradeoffs between transformer and SSM layers.

“I highly recommend Sasha Rush's video on it”