Are AI labs pelicanmaxxing?(dylancastillo.co)
632 points by dcastm | 237 comments
Blog post investigating whether AI labs are optimizing their LLMs for Simon Willison's 'SVG of a pelican riding a bicycle' informal benchmark.
1 story tagged benchmark-gaming, newest first.
632 points by dcastm | 237 comments
Blog post investigating whether AI labs are optimizing their LLMs for Simon Willison's 'SVG of a pelican riding a bicycle' informal benchmark.