metr.org on Hacker News

METR Report on OpenAI / Hugging Face Hacking Incident(metr.org)

93 points by stikit 1 month ago | 75 comments

Many SWE-bench-Passing PRs would not be merged(metr.org)

256 points by mustaphah 7 months ago | 138 comments

We are changing our developer productivity experiment design(metr.org)

72 points by ej88 8 months ago | 45 comments

Measuring AI Ability to Complete Long Tasks(metr.org)

222 points by spicypete 10 months ago | 175 comments

Measuring the impact of AI on experienced open-source developer productivity(metr.org)

638 points by dheerajvs 1 year ago | 421 comments

METR research post on a randomized controlled trial finding that early-2025 AI tools made experienced open-source developers 19% slower on their own repositories.