Anjney Midha's Plan to Radically Lower the Price of Compute
6/13/202650 min
Anjney Midha wrote the first check to Anthropic. He teaches a viral course at Stanford on how AI works. And he was, until recently, a partner at a16z. In other words, he is AI-industry royalty. Midha's new project is AMP PBC, a company that believes it can radically lower the price of compute. To accomplish that, he is working on building a compute grid that turns GPUs into a standardized utility. But right now, compute is too fragmented. It's too heterogeneous. And given the way contracts are structured, he says that labs are being forced to spend money on capacity that often goes unused. In other words, small labs are forced to pay up for big, long-term contracts, even though their own demand (particularly during model training) may be very spiky. On this episode, Midha explains how the market for compute currently works and why he believes there's a software solution that could significantly improve compute utilization. He also tells us why he does not anticipate one company will emerge as the dominate player and that instead we'll have a wide range of models, each optimally used in specific applications.
Read more:
Amazon Says Its Data Centers Use 2.5 Billion Gallons of Water
Oracle Falls Most in Six Months on Mounting Data Center Costs
Only http://Bloomberg.com subscribers can get the Odd Lots newsletter in their inbox each week, plus unlimited access to the site and app. Subscribe at bloomberg.com/subscriptions/oddlots
Subscribe to the Odd Lots Newsletter
Join the conversation: discord.gg/oddlots
See omnystudio.com/listener for privacy information.
Clips
Transcript preview
First 90 secondsTracy Alloway· Host0:00
Odd Lots is brought to you by VanEck. For years, investors basically forgot about real assets, energy, gold, and infrastructure, but look at what's driving markets now. Central banks loading up on gold, massive CapEx cycles, currencies doing weird things, these assets are at the center of it. RAAX, the VanEck Real Assets ETF, is an actively managed one-stop shop for real assets spanning gold, commodities, natural resource equities, and more. Go to vaneck.com/raaxpod to learn more. Fun disclosures later in this episode.
Speaker 20:32
The thing about AI for business, it may not automatically fit the way your business works. At IBM, we've seen this firsthand. But by embedding AI across HR, IT, and procurement processes, we've reduced costs by millions, slashed repetitive tasks, and freed thousands of hours for strategic work. Now we're helping companies get smarter by putting AI where it actually pays off, deep in the work that moves the business. Let's create smarter business, IBM.
Speaker 31:02
Never bet against American grit or American energy. Through innovation, Venture Global is not only building some of the largest energy facilities in the world right here in the United States, but delivering American energy at a fraction of the cost and a fraction of the time. So while others are busy talking, we're busy building. That's Venture Global. That's unstoppable energy.