#bitnet on Hacker News

3 stories tagged bitnet, newest first.

Screenshot of github.com: ESP32S3 cluster running 1.58-bit (BitNet) Language model

ESP32S3 cluster running 1.58-bit (BitNet) Language model (github.com)

143 points by nkko 27 days ago | 31 comments

GitHub repository for a 7-node ESP32-S3 cluster running a 0.4B-parameter LLM using 1.58-bit BitNet ternary quantization over an SPI daisy-chain.

esp32-s3 bitnet llm ternary-quantization

Screenshot of github.com: BitNet: Inference framework for 1-bit LLMs

BitNet: Inference framework for 1-bit LLMs (github.com)

357 points by redm 7 months ago | 163 comments

GitHub repository for Microsoft's BitNet, the official inference framework for 1-bit large language models.

bitnet 1-bit-llm quantization llm-inference

Screenshot of arxiv.org: The Era of 1-bit LLMs: ternary parameters for cost-effective computing

The Era of 1-bit LLMs: ternary parameters for cost-effective computing (arxiv.org)

962 points by fgfm 2 years ago | 419 comments

arXiv paper introducing BitNet b1.58, a ternary-weight (-1, 0, 1) LLM matching full-precision Transformers while being far cheaper in latency, memory, and energy.

bitnet 1-bit-llm quantization ternary-weights

#bitnet on Hacker News

ESP32S3 cluster running 1.58-bit (BitNet) Language model(github.com)

BitNet: Inference framework for 1-bit LLMs(github.com)

The Era of 1-bit LLMs: ternary parameters for cost-effective computing(arxiv.org)

ESP32S3 cluster running 1.58-bit (BitNet) Language model (github.com)

BitNet: Inference framework for 1-bit LLMs (github.com)

The Era of 1-bit LLMs: ternary parameters for cost-effective computing (arxiv.org)