Efficient Memory Management for Large Language Model Serving with PagedAttention(arxiv.org)87 points by jmorgan 3 years ago | 17 comments
Spark-TTS: Text-2-Speech Model Single-Stream Decoupled Tokens [pdf](arxiv.org)64 points by bilekas 1 year ago | 3 comments
QLoRA: Efficient Finetuning of Quantized LLMs(arxiv.org)270 points by Garcia98 3 years ago | 90 comments
Infinite Retrieval: Attention enhanced LLMs in long-context processing(arxiv.org)26 points by TaurenHunter 1 year ago | 3 comments
δ-mem: Efficient Online Memory for Large Language Models(arxiv.org)227 points by 44za12 5 months ago | 58 comments