CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs(arxiv.org)96 points by matt_d 5 months ago | 12 comments
Brainformers: Trading Simplicity for Efficiency(arxiv.org)70 points by PaulHoule 3 years ago | 3 comments
Theoretical limitations of multi-layer Transformer(arxiv.org)93 points by fovc 1 year ago | 17 comments
LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale (2022)(arxiv.org)125 points by tosh 3 years ago | 15 comments
A Mathematical Perspective on Transformers(arxiv.org)63 points by georgehill 2 years ago | 4 comments