#1-bit-llm on Hacker News

3 stories tagged 1-bit-llm, newest first.

Screenshot of prismml.com: Show HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs

Show HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs (prismml.com)

385 points by PrismML 6 months ago | 144 comments

Homepage of PrismML, a startup building ultra-dense, compact AI models such as its 1-bit Bonsai LLMs for smartphones and efficient datacenters.

1-bit-llm model-quantization on-device-ai bonsai

Screenshot of github.com: BitNet: Inference framework for 1-bit LLMs

BitNet: Inference framework for 1-bit LLMs (github.com)

357 points by redm 7 months ago | 163 comments

GitHub repository for Microsoft's BitNet, the official inference framework for 1-bit large language models.

bitnet 1-bit-llm quantization llm-inference

Screenshot of arxiv.org: The Era of 1-bit LLMs: ternary parameters for cost-effective computing

The Era of 1-bit LLMs: ternary parameters for cost-effective computing (arxiv.org)

962 points by fgfm 2 years ago | 419 comments

arXiv paper introducing BitNet b1.58, a ternary-weight (-1, 0, 1) LLM matching full-precision Transformers while being far cheaper in latency, memory, and energy.

bitnet 1-bit-llm quantization ternary-weights

#1-bit-llm on Hacker News

Show HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs(prismml.com)

BitNet: Inference framework for 1-bit LLMs(github.com)

The Era of 1-bit LLMs: ternary parameters for cost-effective computing(arxiv.org)

Show HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs (prismml.com)

BitNet: Inference framework for 1-bit LLMs (github.com)

The Era of 1-bit LLMs: ternary parameters for cost-effective computing (arxiv.org)