What does it take to train a frontier model? What's the know-how, the secret sauce that makes firms lets OpenAI and Deepmind push the limits of what's possible? How much are Chinese firms benefitting from western open source, and in the long term is it possible for western labs to maintain an edge?
The hosts of the excellent Latent Space podcast, Alessio Fanelli of Decibel VC and Shawn Wang of Smol AI, come on to discuss.
We get into:
Outtro music: CHEKI https://open.spotify.com/track/1zKL2bOEkMDGuIjLhG34YA?si=9a713a88aa3d4f71
Cover photo: "Inkstand with A Madman Distilling His Brains" 1600s Urbino. Kind of like training a model! https://www.metmuseum.org/art/collection/search/188899
The met description: In this whimsical maiolica sculpture, a well-dressed man leans forward in his seat with his head in a covered pot set above a fiery hearth. The vessel beside the hearth almost certainly held ink. The man’s actions are explained by an inscription on the chair: "I distill my brain and am totally happy." Thus the task of the writer is equated with distillation—the process through which a liquid is purified by heating and cooling, extracting its essence.
Learn more about your ad choices. Visit megaphone.fm/adchoices
How Chinese Ink Painting Survived the CCP
Global Standards: What's the Deal?
Shanghai Lockdown + Wang Huning's Unhappy Travels in America + Classics in China
China/Russia + Why China's Making More Nukes
How will Beijing Respond to the War in Ukraine?
Taiwan indie music 101, the Taipei underground and tankie rappers
Orgies, US Navy Corruption and The Fall of Fat Leonard
UkraineTalk: The View from Berlin
Xi-Putin Relations and the view from Riga
How Eastern Europe Sees China and The War in Ukraine
Emergency Pod: Tooze and Klein on Nuclear War, The EU's Future, and What's Next
Emergency Pod: The View From Prague + Future of the EU
Emergency Pod: What's Driving Putin, Sanctions, Drugs, Echoes from History, Xi, Chips
Emergency Pod: Russia and Cyber Operations
Space Industry Literacy, NASA, and Elon versus the Taliban
Rainbow Farts: Chinese Internet Slang You Need to Know
China's Wolf Warrior Diplomacy, Part 2
China's Wolf Warrior Diplomacy, Part 1
Imperial Japan + Export Controls = Pearl Harbor!?
Year in Review + Future Plans for ChinaTalk
Create your
podcast in
minutes
It is Free