δ-mem: Efficient Online Memory for Large Language Models(arxiv.org)227 points by 44za12 5 months ago | 58 comments
SparseLoCo: Communication-Efficient LLM Training(arxiv.org)11 points by synapz_org 1 year ago | 1 comments
Hierarchical Autoregressive Modeling for Memory-Efficient Language Generation(arxiv.org)40 points by PaulHoule 9 months ago | 1 comments
Unsupervised Elicitation of Language Models(arxiv.org)128 points by kordlessagain 1 year ago | 18 comments
AutoHete: An Automatic and Efficient Heterogeneous Training System for LLMs(arxiv.org)41 points by PaulHoule 1 year ago | 0 comments