What does it take to train a frontier model? What's the know-how, the secret sauce that makes firms lets OpenAI and Deepmind push the limits of what's possible? How much are Chinese firms benefitting from western open source, and in the long term is it possible for western labs to maintain an edge?
The hosts of the excellent Latent Space podcast, Alessio Fanelli of Decibel VC and Shawn Wang of Smol AI, come on to discuss.
We get into:
Outtro music: CHEKI https://open.spotify.com/track/1zKL2bOEkMDGuIjLhG34YA?si=9a713a88aa3d4f71
Cover photo: "Inkstand with A Madman Distilling His Brains" 1600s Urbino. Kind of like training a model! https://www.metmuseum.org/art/collection/search/188899
The met description: In this whimsical maiolica sculpture, a well-dressed man leans forward in his seat with his head in a covered pot set above a fiery hearth. The vessel beside the hearth almost certainly held ink. The man’s actions are explained by an inscription on the chair: "I distill my brain and am totally happy." Thus the task of the writer is equated with distillation—the process through which a liquid is purified by heating and cooling, extracting its essence.
Learn more about your ad choices. Visit megaphone.fm/adchoices
Sci-fi Mecha Wu Zetian, YouTube on China and C-drama Fails
US-China Science Relations and the PhDs Caught in the Middle
CSET: How to Break the Think Tank Mold
Son Eating and Prince-Slaying: Stratagems of the Warring States
6th Plenum: Open Source CCP
Selling China's Story
Red Roulette: It Sucks to be a Chinese Billionaire
Why Does China Have Blackouts?
Science & Technology for National Security
China's Space Plans for the 2020s
What Evergrande Means for China
Mao and the Monkey King
Russia's Pivot to Asia From Czars to Putin
Tech Crackdown, Common Prosperity, and The Dao of ChinaTalk
Tooze and Klein on China's Economic History and Future
SpaceX, Elon and their Chinese Imitators
BadChinaTake on China Twitter
Hot Space Summer: China's Commercial Space Boom
Tough Tech, Roombas, Valleys of Death, and Woolly Mammoths
Labs over Fabs: Why the US and EU Should Invest in the Future of Semiconductors
Create your
podcast in
minutes
It is Free