Show HN: Pac-Bench – How well can models one-shot a Pac-Man game?(jonclegg.github.io)

62 points by thefourthchime 27 days ago | 38 comments

PacBench, a benchmark site comparing how well AI model and harness combinations recreate a Pac-Man game in a single HTML page from one prompt.

I tested 10 model/harness combinations on the same Three.js task(alvins82.github.io)

98 points by alvins82 1 month ago | 55 comments

Batmobile: 10-20x Faster CUDA Kernels for Equivariant Graph Neural Networks(elliotarledge.com)

83 points by ipnon 9 months ago | 11 comments

OpenAI O3 breakthrough high score on ARC-AGI-PUB(arcprize.org)

1578 points by maurycy 1 year ago | 1581 comments

ARC Prize blog post by François Chollet reporting OpenAI's o3 scoring 75.7% (and 87.5% at high compute) on the ARC-AGI semi-private evaluation set.

ARC Prize – a $1M+ competition towards open AGI progress(arcprize.org)

527 points by mikeknoop 2 years ago | 266 comments

Blog post announcing ARC Prize, a $1M+ public competition by Mike Knoop and François Chollet to beat and open-source a solution to the ARC-AGI benchmark.

ARC-AGI-3(arcprize.org)

481 points by lairv 7 months ago | 317 comments

ARC Prize page for ARC-AGI-3, an interactive game-based benchmark for testing AI reasoning, with a playable demo and grid of puzzle games.