Sub-1-Bit LLM Compression via Latent Factorization(github.com)
70 points by brainless | 12 comments
GitHub repository from SamsungLabs with the official implementation of LittleBit and LittleBit-2, sub-1-bit LLM compression via latent factorization.
#llm-quantization on Hacker News
1 story tagged llm-quantization, newest first.