Are AI labs pelicanmaxxing?(dylancastillo.co)
632 points by dcastm | 237 comments
Blog post investigating whether AI labs are optimizing their LLMs for Simon Willison's 'SVG of a pelican riding a bicycle' informal benchmark.
#evals on Hacker News
2 stories tagged evals, newest first.
Things we learned about LLMs in 2024(simonwillison.net)
871 points by simonw | 530 comments
Simon Willison's blog post reviewing the major developments, themes and pivotal moments in large language models during 2024.