What does it take to train a frontier model? What's the know-how, the secret sauce that makes firms lets OpenAI and Deepmind push the limits of what's possible? How much are Chinese firms benefitting from western open source, and in the long term is it possible for western labs to maintain an edge?
The hosts of the excellent Latent Space podcast, Alessio Fanelli of Decibel VC and Shawn Wang of Smol AI, come on to discuss.
We get into:
Outtro music: CHEKI https://open.spotify.com/track/1zKL2bOEkMDGuIjLhG34YA?si=9a713a88aa3d4f71
Cover photo: "Inkstand with A Madman Distilling His Brains" 1600s Urbino. Kind of like training a model! https://www.metmuseum.org/art/collection/search/188899
The met description: In this whimsical maiolica sculpture, a well-dressed man leans forward in his seat with his head in a covered pot set above a fiery hearth. The vessel beside the hearth almost certainly held ink. The man’s actions are explained by an inscription on the chair: "I distill my brain and am totally happy." Thus the task of the writer is equated with distillation—the process through which a liquid is purified by heating and cooling, extracting its essence.
Learn more about your ad choices. Visit megaphone.fm/adchoices
Xi: Failed Reformer?
China's Solar Industry
Larry Summers on China
After Xi: How Past CCP Successions Can Teach Us What Happens Next
China's Cyber Strengths + How to Analyze Policy
DARPA and How to R&D Right
In-Q-Tel on Chips, CFIUS, and The Valley of Death
How to Solve America's R&D Bottlenecks
Emergency Pod! Endless Frontier Act Butchered!
How Beijing Sees Korea
600 Years Of Sino-Korean Relations
Industrial Policy: How the Green New Deal's Architects Would Do IP
Elon Musk, TSMC, Open Source, Endless Frontier and Zhang Yiming
Can China Win a War Over Taiwan? Plus Eve Online
China's Anti-Monopoly Moment
China's Booming Podcast Ecosystem
Why Are Chinese TV Dramas So Bad?
How Huarong Explains China's Creaky Financial System
Bo Xilai and How Xi Learned from the Chongqing Model
'Invisible China': How the Urban-Rural Divide Threatens China’s Rise
Create your
podcast in
minutes
It is Free