ternary-quantization on Hacker News: 1 stories with screenshots

ESP32S3 cluster running 1.58-bit (BitNet) Language model (github.com)

143 points by nkko 27 days ago | 31 comments

GitHub repository for a 7-node ESP32-S3 cluster running a 0.4B-parameter LLM using 1.58-bit BitNet ternary quantization over an SPI daisy-chain.