3 stories tagged optimizers, newest first.
27 points by matt_d | 2 comments
Research blog post introducing OPAL, a reactive optimizer where an LLM agent monitors training dynamics and rewrites the optimizer's source code during a training run.
426 points by bblcla | 78 comments
Blog post recounting how a training loss plateau turned out to be a PyTorch bug, traced through optimizer internals down to GPU kernels.
388 points by r4um | 48 comments
A blog post listing papers, posts, and videos on programming languages and compilers that changed the author's thinking, with short commentary on each.