QLoRA: Efficient Finetuning of Quantized LLMs(arxiv.org)270 points by Garcia98 3 years ago | 90 comments
A robust, open-source framework for Spiking Neural Networks on low-end FPGAs(arxiv.org)62 points by PaulHoule 1 year ago | 5 comments
SplitQuantV2: Enhancing Low-Bit Quantization of LLMs Without GPUs(arxiv.org)25 points by PaulHoule 1 year ago | 5 comments
LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale (2022)(arxiv.org)125 points by tosh 3 years ago | 15 comments
Artificial Needles to Real Haystacks: Improving Retrieval Capabilities in LLMs(arxiv.org)92 points by veryluckyxyz 2 years ago | 18 comments