A 30B Qwen model walks into a Raspberry Pi and runs in real time(byteshape.com)
338 points by dataminer | 121 comments
ByteShape blog post describing how they quantized Qwen3-30B-A3B-Instruct with their Shapelearn bitlength method to run in real time on a Raspberry Pi.