Do transformers need three projections? Systematic study of QKV variants (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Do transformers need three projections? Systematic study of QKV variants

First screen, captured 4 months ago.

Looks similar

Screenshot of arxiv.org: Transformers as Support Vector Machines

Transformers as Support Vector Machines (arxiv.org)

209 points by fofoz 3 years ago | 129 comments

Screenshot of arxiv.org: CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs

CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs (arxiv.org)

96 points by matt_d 5 months ago | 12 comments

Screenshot of arxiv.org: Transformers Are Bayesian Networks

Transformers Are Bayesian Networks (arxiv.org)

27 points by Anon84 7 months ago | 16 comments

Screenshot of arxiv.org: A Mathematical Perspective on Transformers

A Mathematical Perspective on Transformers (arxiv.org)

63 points by georgehill 2 years ago | 4 comments

Screenshot of arxiv.org: Transformers without normalization

Transformers without normalization (arxiv.org)

33 points by kaycebasques 1 year ago | 3 comments

Screenshot of arxiv.org: Transformers Are Inherently Succinct (2025)

Transformers Are Inherently Succinct (2025)(arxiv.org)

45 points by bearseascape 5 months ago | 6 comments