#apple-neural-engine on Hacker News

2 stories tagged apple-neural-engine, newest first.

Qwen3.8-27B on the iPhone 18 Neural Engine at 15–70 tok/s (1.5 bpw)(twitter.com)

18 points by anemll 8 days ago | 3 comments

A tweet from ANEMLL reporting a 27B-parameter Qwen model running on the iPhone 18 Neural Engine at 15–70 tokens per second using 1.5-bit quantization.

on-device-llm qwen apple-neural-engine iphone

Screenshot of maderix.substack.com: Inside the M4 Apple Neural Engine, Part 1: Reverse Engineering

Inside the M4 Apple Neural Engine, Part 1: Reverse Engineering (maderix.substack.com)

359 points by zdw 7 months ago | 104 comments

A Substack post, the first in a series, describing how the author reverse engineered the Apple M4 Neural Engine to bypass CoreML and talk directly to the hardware.

apple-neural-engine apple-m4 reverse-engineering coreml

#apple-neural-engine on Hacker News

Qwen3.8-27B on the iPhone 18 Neural Engine at 15–70 tok/s (1.5 bpw)(twitter.com)

Inside the M4 Apple Neural Engine, Part 1: Reverse Engineering(maderix.substack.com)

Inside the M4 Apple Neural Engine, Part 1: Reverse Engineering (maderix.substack.com)