Hierarchical Autoregressive Modeling for Memory-Efficient Language Generation(arxiv.org)40 points by PaulHoule 9 months ago | 1 comments
SparseLoCo: Communication-Efficient LLM Training(arxiv.org)11 points by synapz_org 1 year ago | 1 comments
Type-constrained code generation with language models(arxiv.org)237 points by tough 1 year ago | 109 comments
AutoHete: An Automatic and Efficient Heterogeneous Training System for LLMs(arxiv.org)41 points by PaulHoule 1 year ago | 0 comments
QLoRA: Efficient Finetuning of Quantized LLMs(arxiv.org)270 points by Garcia98 3 years ago | 90 comments
Search-R1: Training LLMs to Reason and Leverage Search Engines with RL(arxiv.org)87 points by jonbaer 1 year ago | 9 comments