The Era of 1-bit LLMs: ternary parameters for cost-effective computing(arxiv.org)
962 points by fgfm | 419 comments
arXiv paper introducing BitNet b1.58, a ternary-weight (-1, 0, 1) LLM matching full-precision Transformers while being far cheaper in latency, memory, and energy.






