Is One Layer Enough? A Single Transformer Layer Matches Full-Parameter RL Train (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Is One Layer Enough? A Single Transformer Layer Matches Full-Parameter RL Train

First screen, captured 3 months ago.

Looks similar

Screenshot of arxiv.org: Transformer Layers as Painters

Transformer Layers as Painters (arxiv.org)

67 points by fzliu 2 years ago | 9 comments

Screenshot of arxiv.org: Transformers as Support Vector Machines

Transformers as Support Vector Machines (arxiv.org)

209 points by fofoz 3 years ago | 129 comments

Screenshot of arxiv.org: Transformers without normalization

Transformers without normalization (arxiv.org)

33 points by kaycebasques 1 year ago | 3 comments

Screenshot of arxiv.org: Can a transformer represent a Kalman filter?

Can a transformer represent a Kalman filter?(arxiv.org)

160 points by bluish29 2 years ago | 55 comments

Screenshot of arxiv.org: TinyLoRA – Learning to Reason in 13 Parameters

TinyLoRA – Learning to Reason in 13 Parameters (arxiv.org)

227 points by sorenjan 7 months ago | 42 comments

Screenshot of arxiv.org: Theoretical limitations of multi-layer Transformer

Theoretical limitations of multi-layer Transformer (arxiv.org)

93 points by fovc 1 year ago | 17 comments