Theoretical limitations of multi-layer Transformer (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Theoretical limitations of multi-layer Transformer

First screen, captured 1 year ago.

Looks similar

Screenshot of arxiv.org: Transformers without normalization

Transformers without normalization (arxiv.org)

33 points by kaycebasques 1 year ago | 3 comments

Screenshot of arxiv.org: LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale (2022)

LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale (2022)(arxiv.org)

125 points by tosh 3 years ago | 15 comments

Screenshot of arxiv.org: Log-Linear Attention

Log-Linear Attention (arxiv.org)

19 points by sva_ 1 year ago | 3 comments

Screenshot of arxiv.org: Simplifying Transformer Blocks

Simplifying Transformer Blocks (arxiv.org)

122 points by georgehill 2 years ago | 42 comments

Screenshot of arxiv.org: Pre-Trained Large Language Models Use Fourier Features for Addition (2024)

Pre-Trained Large Language Models Use Fourier Features for Addition (2024)(arxiv.org)

125 points by Kye 1 year ago | 38 comments

Screenshot of arxiv.org: Transformer Layers as Painters

Transformer Layers as Painters (arxiv.org)

67 points by fzliu 2 years ago | 9 comments