Breaking the 1.58-bit Barrier for Ternary LLMs(arxiv.org)232 points by matt_d 1 month ago | 37 comments
SplitQuantV2: Enhancing Low-Bit Quantization of LLMs Without GPUs(arxiv.org)25 points by PaulHoule 1 year ago | 5 comments
HyperAttention: Long-Context Attention in Near-Linear Time(arxiv.org)61 points by kelseyfrog 3 years ago | 10 comments
SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks(arxiv.org)42 points by amai 1 year ago | 15 comments
QLoRA: Efficient Finetuning of Quantized LLMs(arxiv.org)270 points by Garcia98 3 years ago | 90 comments
Can LLMs Beat Classical Hyperparameter Optimization Algorithms?(arxiv.org)95 points by galsapir 4 months ago | 15 comments