#quantization-aware-training on Hacker News

3 stories tagged quantization-aware-training, newest first.

Screenshot of blog.google: Gemma 4 QAT models: Optimizing compression for mobile and laptop efficiency

Gemma 4 QAT models: Optimizing compression for mobile and laptop efficiency (blog.google)

384 points by theanonymousone 4 months ago | 120 comments

Google blog post announcing Gemma 4 models trained with Quantization-Aware Training to cut memory use and improve on-device performance on mobile and laptops.

gemma-4 quantization-aware-training google on-device-ai

Screenshot of github.com: Show HN: Z80-μLM, a 'Conversational AI' That Fits in 40KB

Show HN: Z80-μLM, a 'Conversational AI' That Fits in 40KB (github.com)

457 points by quesomaster9000 10 months ago | 101 comments

GitHub repository for Z80-μLM, a 2-bit quantized character-level language model that runs as a 40KB CP/M .COM binary on a Z80 processor.

z80 quantization language-model retrocomputing

Screenshot of developers.googleblog.com: Gemma 3 QAT Models: Bringing AI to Consumer GPUs

Gemma 3 QAT Models: Bringing AI to Consumer GPUs (developers.googleblog.com)

571 points by emrah 1 year ago | 259 comments

Google Developers Blog post announcing Gemma 3 models trained with quantization-aware training so they can run on consumer GPUs.

gemma-3 quantization-aware-training google llm

#quantization-aware-training on Hacker News

Gemma 4 QAT models: Optimizing compression for mobile and laptop efficiency(blog.google)

Show HN: Z80-μLM, a 'Conversational AI' That Fits in 40KB(github.com)

Gemma 3 QAT Models: Bringing AI to Consumer GPUs(developers.googleblog.com)

Gemma 4 QAT models: Optimizing compression for mobile and laptop efficiency (blog.google)

Show HN: Z80-μLM, a 'Conversational AI' That Fits in 40KB (github.com)

Gemma 3 QAT Models: Bringing AI to Consumer GPUs (developers.googleblog.com)