Tracr github.com ↗
DeepMind's compiler that turns RASP programs into transformer weights for interpretability research.
LibraryAI & MLinterpretabilitytransformerscompilercompilation
Captured
Recommended in 1 thread
The 'Astra can read and write weights to improve Qwen' post is misleadinghonnibal.dev ·
Cited as prior work showing rule-based logic can be written directly into transformer weights.
Similar tools
- Thinking Like Transformers ↗AI & ML0 threads
ICML 2021 paper introducing RASP, a language for expressing computations transformers can perform.
- 0 threads
- 1 thread
- 1 thread
- 12 threads
- 2 threads
- 3 threads
- 8 threads
Also in AI & ML
- 19 threads
- 12 threads
- 12 threads
- 11 threads
- 9 threads
- 8 threads
- 7 threads
- 7 threads
- 5 threads
- 5 threads
- 4 threads
- 4 threads
Link from a commenter, not checked or endorsed by us: ↗ https://github.com/deepmind/tracr

















