30% drop in O1-preview accuracy when Putnam problems are slightly variated(openreview.net)
529 points by optimalsolver | 490 comments
OpenReview paper page reporting that OpenAI's o1-preview loses about 30% accuracy on slightly varied Putnam math competition problems.