Transformers Represent Belief State Geometry in Their Residual Stream (lesswrong.com) | HN Screenshots

YHacker Newsscreenshots

Screenshot of lesswrong.com: Transformers Represent Belief State Geometry in Their Residual Stream

First screen, captured 2 years ago.

Looks similar

Screenshot of manifestai.com: Linear transformers are faster after all

Linear transformers are faster after all (manifestai.com)

94 points by JoelEinbinder 2 years ago | 16 comments

Screenshot of microsoft.github.io: RenderFormer: Neural rendering of triangle meshes with global illumination

RenderFormer: Neural rendering of triangle meshes with global illumination (microsoft.github.io)

259 points by klavinski 1 year ago | 51 comments

Screenshot of connorjdavis.com: Intuitions for Tranformer Circuits

Intuitions for Tranformer Circuits (connorjdavis.com)

58 points by cjamsonhn 7 months ago | 4 comments

Screenshot of arxiv.org: CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs

CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs (arxiv.org)

96 points by matt_d 5 months ago | 12 comments

Screenshot of arxiv.org: A Mathematical Perspective on Transformers

A Mathematical Perspective on Transformers (arxiv.org)

63 points by georgehill 2 years ago | 4 comments

Screenshot of arxiv.org: Transformers Are Bayesian Networks

Transformers Are Bayesian Networks (arxiv.org)

27 points by Anon84 7 months ago | 16 comments