sequence-modeling on Hacker News: 1 stories with screenshots

Screenshot of arxiv.org: Attention Is Not What You Need (2025)

Attention Is Not What You Need (2025)(arxiv.org)

152 points by westurner 14 hours ago | 53 comments

arXiv paper proposing an attention-free sequence model using Grassmann flows and Plucker coordinates, compared against Transformers on Wikitext-2 and SNLI.

attention-free-architecture grassmann-manifold transformers sequence-modeling

#sequence-modeling on Hacker News

Attention Is Not What You Need (2025)(arxiv.org)