Understanding the Most Viral Chart in Artificial Intelligence
4/25/202657 min
We live in an era of charts that are going up and to the right. This image obviously describes the stock market, particularly any company whose business is adjacent to artificial intelligence. But beyond stocks, another sort of chart we keep seeing is of AI capabilities also going up and to the right. The most famous and viral of these comes from an organization called METR, which stands for Model Evaluation and Threat Research. The organization is focused on understanding the degree to which AI models can engage in autonomous, complex tasks. METR see this is as a particularly important benchmark, given the risk that AI could one day be engaged in recursive self improvement, taking humans out of the loop. But how do you really gauge a model's ability to do complex problems. And what is being measured for exactly? On this episode, we speak with METR's President Chris Painter as well as Joel Becker, a member of the technical staff who works on evaluation methods for the organization. We discuss both the mechanics and the philosophy of METR's work, and what it means when we see a a chart showing that Clause Opus 4.6 can do a task that would take a human nearly 12 hours.
Read more:
DeepSeek Unveils Flagship AI Model a Year After Breakthrough
Meta Inks Deal to Use Amazon’s Graviton Processors for AI
Only http://Bloomberg.com subscribers can get the Odd Lots newsletter in their inbox each week, plus unlimited access to the site and app. Subscribe at bloomberg.com/subscriptions/oddlots
Subscribe to the Odd Lots Newsletter
Join the conversation: discord.gg/oddlots
See omnystudio.com/listener for privacy information.
Clips
Transcript preview
First 90 secondsSpeaker 00:00
Hey, Fidelity. [piano note] What's it cost to invest with the Fidelity app?
Tracy Alloway· Host0:04
[piano note] Start with as little as $1 with no account fees or trade commissions on US stocks and ETFs.
Speaker 00:11
Hmm. That's music to my ears.
Tracy Alloway· Host0:14
I can only talk.
Chris Painter· Guest0:15
[upbeat music] Investing involves risk, including risk of loss. Zero account fees apply to retail brokerage accounts only. Sell order assessment fee not included. A limited number of ETFs are subject to a transaction-based service fee of $100. See full list at fidelity.com/commissions. Fidelity Brokerage Services LLC, member NYSE, SIPC.
Speaker 00:28
[piano music] Being a small business owner isn't just a career, it's a calling. Chase for Business knows how much heart and effort go into building something of your own. Manage all your business finances from banking to payments to credit cards all in one place with Chase's digital tools. Plus, access online resources designed to help your business thrive. Learn more at chase.com/business. Chase for Business, make more of what's yours. The Chase mobile app is available for select mobile devices. Message and data rates may apply. JPMorgan Chase Bank NA, member FDIC. Copyright 2026, JPMorgan Chase & Co.
Speaker 31:05
Travel smarter, not harder at America's Best Value Inn by Sonesta. With convenient locations from coast to coast and value-packed comfort at every turn, it's a practical choice for road trips, quick getaways, and everyday travel that keeps things simple without sacrificing comfort. And when you're a Sonesta Travel Pass member, staying at America's Best Value Inn means earning points toward free nights, upgrades, and more every time you stay. Go to sonesta.com