Bytes are all you need: Transformers operating directly on file bytes (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Bytes are all you need: Transformers operating directly on file bytes

First screen, captured 3 years ago.

Looks similar

Screenshot of arxiv.org: Transformers as Support Vector Machines

Transformers as Support Vector Machines (arxiv.org)

209 points by fofoz 3 years ago | 129 comments

Screenshot of arxiv.org: Vision Transformers Need Registers

Vision Transformers Need Registers (arxiv.org)

74 points by felineflock 1 year ago | 9 comments

Screenshot of arxiv.org: Transformers Are Bayesian Networks

Transformers Are Bayesian Networks (arxiv.org)

27 points by Anon84 7 months ago | 16 comments

Screenshot of arxiv.org: Do transformers need three projections? Systematic study of QKV variants

Do transformers need three projections? Systematic study of QKV variants (arxiv.org)

202 points by Anon84 4 months ago | 39 comments

Screenshot of arxiv.org: LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale (2022)

LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale (2022)(arxiv.org)

125 points by tosh 3 years ago | 15 comments

Screenshot of arxiv.org: RWKV: Reinventing RNNs for the Transformer Era

RWKV: Reinventing RNNs for the Transformer Era (arxiv.org)

318 points by ianbutler 3 years ago | 164 comments

arXiv paper introducing RWKV, a model architecture combining Transformer-style parallel training with efficient RNN inference via linear attention.

rwkv rnn transformers linear-attention