▶ Watch ↗AI Engineer Code 20251:15:52
Conference affiliation: METR · 2025
Joel Becker is the founder and chief executive of Qally’s and an AI evaluation researcher whose work tests whether increasingly capable models make skilled people more productive. Formerly on the technical staff at METR, he helped develop human-calibrated measures of autonomous AI capabilities and co-led a randomized experiment that found experienced open-source developers worked more slowly with AI assistance.
Becker studied economics and econometrics at the University of Bristol, worked as a predoctoral fellow at Harvard and the National Bureau of Economic Research, pursued graduate economics research at New York University, and was a visiting researcher at Oxford’s Global Priorities Institute. He also co-owned a statistics consultancy serving professional soccer teams.
His research extended into genomics: he was first author of a 2021 study introducing the Polygenic Index Repository and examining bias in genetic prediction. He subsequently founded Qally’s and worked on evaluation methods at METR, applying economic ideas about incentives, counterfactuals, and measurement to advanced AI systems.
His research on compute slowdowns further examines how constraints on computing investment could delay projected AI capability milestones. Across these projects, Becker focuses on whether measured performance survives the practical demands of real work: ambiguous goals, accumulated context, coordination, quality control, and deciding which tasks are actually worth doing.
▶ Watch ↗AI Engineer Code 20251:15:52
▶ Watch ↗AI Engineer Code 202521:22
Loading more talks and highlights…