Reactive Optimizers: rewrite the optimizer's source code during training(xingjianbai.com)
27 points by matt_d | 2 comments
Research blog post introducing OPAL, a reactive optimizer where an LLM agent monitors training dynamics and rewrites the optimizer's source code during a training run.