AutoHete: An Automatic and Efficient Heterogeneous Training System for LLMs(arxiv.org)41 points by PaulHoule 1 year ago | 0 comments
HMT: Hierarchical Memory Transformer for Long Context Language Processing(arxiv.org)83 points by jasondavies 2 years ago | 5 comments
CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs(arxiv.org)96 points by matt_d 5 months ago | 12 comments
Language models are injective and hence invertible(arxiv.org)194 points by mazsa 1 year ago | 136 comments
TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters(arxiv.org)170 points by og_kalu 2 years ago | 28 comments