Brainformers: Trading Simplicity for Efficiency (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Brainformers: Trading Simplicity for Efficiency

First screen, captured 3 years ago.

Looks similar

Screenshot of arxiv.org: Transformers as Support Vector Machines

Transformers as Support Vector Machines (arxiv.org)

209 points by fofoz 3 years ago | 129 comments

Screenshot of arxiv.org: RWKV: Reinventing RNNs for the Transformer Era

RWKV: Reinventing RNNs for the Transformer Era (arxiv.org)

318 points by ianbutler 3 years ago | 164 comments

arXiv paper introducing RWKV, a model architecture combining Transformer-style parallel training with efficient RNN inference via linear attention.

rwkv rnn transformers linear-attention

Screenshot of arxiv.org: QLoRA: Efficient Finetuning of Quantized LLMs

QLoRA: Efficient Finetuning of Quantized LLMs (arxiv.org)

270 points by Garcia98 3 years ago | 90 comments

Screenshot of arxiv.org: Simplifying Transformer Blocks

Simplifying Transformer Blocks (arxiv.org)

122 points by georgehill 2 years ago | 42 comments

Screenshot of arxiv.org: Thinking Like Transformers (2021) [pdf]

Thinking Like Transformers (2021) [pdf](arxiv.org)

107 points by jbay808 3 years ago | 16 comments

Screenshot of arxiv.org: Transformers Can Do Arithmetic with the Right Embeddings

Transformers Can Do Arithmetic with the Right Embeddings (arxiv.org)

186 points by byt3h3ad 2 years ago | 191 comments