Thinking Like Transformers (2021) [pdf] (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Thinking Like Transformers (2021) [pdf]

First screen, captured 3 years ago.

Looks similar

Screenshot of arxiv.org: RWKV: Reinventing RNNs for the Transformer Era

RWKV: Reinventing RNNs for the Transformer Era (arxiv.org)

318 points by ianbutler 3 years ago | 164 comments

arXiv paper introducing RWKV, a model architecture combining Transformer-style parallel training with efficient RNN inference via linear attention.

rwkv rnn transformers linear-attention

Screenshot of arxiv.org: LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale (2022)

LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale (2022)(arxiv.org)

125 points by tosh 3 years ago | 15 comments

Screenshot of arxiv.org: Transformers as Support Vector Machines

Transformers as Support Vector Machines (arxiv.org)

209 points by fofoz 3 years ago | 129 comments

Screenshot of arxiv.org: A Mathematical Perspective on Transformers

A Mathematical Perspective on Transformers (arxiv.org)

63 points by georgehill 2 years ago | 4 comments

Screenshot of arxiv.org: Scaling Transformers to 1B Tokens

Scaling Transformers to 1B Tokens (arxiv.org)

208 points by mottiden 3 years ago | 64 comments

Screenshot of arxiv.org: CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs

CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs (arxiv.org)

96 points by matt_d 5 months ago | 12 comments