PMET: Precise Model Editing in a Transformer(arxiv.org)

109 points by PaulHoule 3 years ago | 12 comments

LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale (2022)(arxiv.org)

125 points by tosh 3 years ago | 15 comments

Mass editing memory in a transformer(memit.baulab.info)

111 points by rodoxcasta 3 years ago | 41 comments

LM2: Large Memory Models(arxiv.org)

105 points by fzliu 1 year ago | 30 comments

CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs(arxiv.org)

96 points by matt_d 5 months ago | 12 comments

RWKV: Reinventing RNNs for the Transformer Era(arxiv.org)

318 points by ianbutler 3 years ago | 164 comments

arXiv paper introducing RWKV, a model architecture combining Transformer-style parallel training with efficient RNN inference via linear attention.