Ways to Use Torch.compile(blog.ezyang.com)
27 points by mfiguiere | 3 comments
First screen, captured .
Looks similar
The AST Typing Problem(blog.ezyang.com)
66 points by smasher164 | 26 comments
A bug that taught me more about PyTorch than years of using it(elanapearl.github.io)
426 points by bblcla | 78 comments
Blog post recounting how a training loss plateau turned out to be a PyTorch bug, traced through optimizer internals down to GPU kernels.
PyTorch: A Reference Language(docs.pytorch.org)
70 points by matt_d | 7 comments
Devtools must be open source(blog.exe.dev)
695 points by bryanmikaelian | 227 comments
Blog post by David Crawshaw on exe.dev arguing that developer tools must be open source, starting from how engineers rarely wrote software for themselves.
Related stories
PyTorch Monarch(pytorch.org)
360 points by jarbus | 42 comments
PyTorch blog post from Meta introducing Monarch, a framework moving beyond multi-controller SPMD for heterogeneous, asynchronous, fault-tolerant ML workflows.
Visual introduction to PyTorch(0byte.io)
372 points by 0bytematt | 25 comments
A visual, beginner-friendly tutorial introducing PyTorch, covering tensors, autograd, and building a simple neural network.
Training LLMs from ground zero as a startup(yitay.net)
360 points by swyx | 92 comments
Yi Tay's blog post on the experience of training large language models from scratch at a startup (Reka), covering compute, infrastructure, and lessons learned.
Deep learning gets the glory, deep fact checking gets ignored(rachel.fast.ai)
549 points by chmaynard | 134 comments
Rachel Thomas blog post on how a high-profile Nature paper using a Transformer to predict enzyme functions contained many errors that received far less attention than the original result.
SmolGPT: A minimal PyTorch implementation for training a small LLM from scratch(github.com)
415 points by amrrs | 52 comments
GitHub repository for smolGPT, a minimal PyTorch implementation for training a small GPT-style language model from scratch.
AI Made Writing Code Easier. It Made Being an Engineer Harder(ivanturkovic.com)
343 points by saikatsg | 242 comments
Blog post by Ivan Turkovic arguing that AI tools make producing code easier while making the broader job of being a software engineer harder.