1-Bit AI Infrastructure (arxiv.org)

Screenshot of arxiv.org: 1-Bit AI Infrastructure

First screen, captured 1 year ago.

Looks similar

Screenshot of arxiv.org: Efficient LLM inference solution on Intel GPU

Efficient LLM inference solution on Intel GPU (arxiv.org)

87 points by PaulHoule 2 years ago | 20 comments

Screenshot of arxiv.org: BitNet b1.58 2B4T Technical Report

BitNet b1.58 2B4T Technical Report (arxiv.org)

91 points by galeos 1 year ago | 28 comments

Screenshot of arxiv.org: The Era of 1-bit LLMs: ternary parameters for cost-effective computing

The Era of 1-bit LLMs: ternary parameters for cost-effective computing (arxiv.org)

962 points by fgfm 2 years ago | 419 comments

arXiv paper introducing BitNet b1.58, a ternary-weight (-1, 0, 1) LLM matching full-precision Transformers while being far cheaper in latency, memory, and energy.

bitnet 1-bit-llm quantization ternary-weights

Screenshot of arxiv.org: SplitQuantV2: Enhancing Low-Bit Quantization of LLMs Without GPUs

SplitQuantV2: Enhancing Low-Bit Quantization of LLMs Without GPUs (arxiv.org)

25 points by PaulHoule 1 year ago | 5 comments

Mistral 7B (arxiv.org)

228 points by fgfm 3 years ago | 101 comments

Screenshot of arxiv.org: Ultra Fast Bert

Ultra Fast Bert (arxiv.org)

227 points by gyre007 2 years ago | 57 comments

Looks similar

Efficient LLM inference solution on Intel GPU(arxiv.org)

BitNet b1.58 2B4T Technical Report(arxiv.org)

The Era of 1-bit LLMs: ternary parameters for cost-effective computing(arxiv.org)

SplitQuantV2: Enhancing Low-Bit Quantization of LLMs Without GPUs(arxiv.org)

Mistral 7B(arxiv.org)

Ultra Fast Bert(arxiv.org)