BitNet b1.58 2B4T Technical Report (arxiv.org)

Screenshot of arxiv.org: BitNet b1.58 2B4T Technical Report

First screen, captured 1 year ago.

Looks similar

InternLM2 (arxiv.org)

121 points by milliondreams 2 years ago | 21 comments

Screenshot of arxiv.org: 1-Bit AI Infrastructure

1-Bit AI Infrastructure (arxiv.org)

136 points by galeos 1 year ago | 28 comments

Screenshot of arxiv.org: Yi: Open Foundation Models by 01.AI

Yi: Open Foundation Models by 01.AI (arxiv.org)

185 points by pama 2 years ago | 75 comments

Screenshot of arxiv.org: The Era of 1-bit LLMs: ternary parameters for cost-effective computing

The Era of 1-bit LLMs: ternary parameters for cost-effective computing (arxiv.org)

962 points by fgfm 2 years ago | 419 comments

arXiv paper introducing BitNet b1.58, a ternary-weight (-1, 0, 1) LLM matching full-precision Transformers while being far cheaper in latency, memory, and energy.

bitnet 1-bit-llm quantization ternary-weights

Mistral 7B (arxiv.org)

228 points by fgfm 3 years ago | 101 comments

Screenshot of arxiv.org: Scalable MatMul-Free Language Modeling

Scalable MatMul-Free Language Modeling (arxiv.org)

177 points by lykahb 2 years ago | 27 comments

Looks similar

InternLM2(arxiv.org)

1-Bit AI Infrastructure(arxiv.org)

Yi: Open Foundation Models by 01.AI(arxiv.org)

The Era of 1-bit LLMs: ternary parameters for cost-effective computing(arxiv.org)

Mistral 7B(arxiv.org)

Scalable MatMul-Free Language Modeling(arxiv.org)