ChinaTalk18 Feb 2024

AI at the Frontier: What it Takes to Compete

What does it take to train a frontier model? What's the know-how, the secret sauce that makes firms lets OpenAI and Deepmind push the limits of what's possible? How much are Chinese firms benefitting from western open source, and in the long term is it possible for western labs to maintain an edge? The hosts of the excellent Latent Space podcast, Alessio Fanelli of Decibel VC and Shawn Wang of Smol AI, come on to discuss. We get into: How the secret sauce used to push the frontier of AI diffuses out of the top labs and into substacks How labs are managing the culture change from quasi-academic outfits to places that have to ship How open source raises the global AI standard, but why there's likely to always be a gap between closed and open source China as a "GPU Poor" nation Three key algorithmic innovations that could reshape the balance of power between the GPU rich and GPU poor Outtro music: CHEKI https://open.spotify.com/track/1zKL2bOEkMDGuIjLhG34YA?si=9a713a88aa3d4f71 Cover photo: "Inkstand with A Madman Distilling His Brains" 1600s Urbino. Kind of like training a model! https://www.metmuseum.org/art/collection/search/188899 The met description: In this whimsical maiolica sculpture, a well-dressed man leans forward in his seat with his head in a covered pot set above a fiery hearth. The vessel beside the hearth almost certainly held ink. The man’s actions are explained by an inscription on the chair: "I distill my brain and am totally happy." Thus the task of the writer is equated with distillation—the process through which a liquid is purified by heating and cooling, extracting its essence. Learn more about your ad choices. Visit megaphone.fm/adchoices

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(563)

WarTalk: GWOT at 25 with Wesley Morgan

Twenty-five years after 9/11, the Pech Valley represents the war in miniature: outposts meant to shield Afghan villages that instead drew the fighting to their doorsteps, built for reasons nobody mann...

5 Sep 1h 21min

Cyber Apocalypse, Now? Hugging Face and the Future of Cyber Risk

OpenAI models mid-training broke out of their sandbox, hacked internal infrastructure, and eventually compromised Hugging Face — the first headline-grade AI breakout, and one that safety researchers s...

2 Sep 1h 10min

WarTalk: USN Readiness Reckoning, Steampunk Navy, and AI Cyberwar with Shashank of the Economist

The USS Abraham Lincoln is coming home after a deployment that stretched past 240 days, and the bill is about to come due: mechanical failures, rations down to the emergency stores, 20,000 unfilled bi...

29 Aug 1h 4min

How AI Becomes a Political Crisis

The political economy of AI — things are getting weird, it seems. We have models on the loose, open weights being dropped from the heavenly temple, and data center protests fanning out across the land...

24 Aug 1h 8min

Lessons from the American Civil War

Note: This episode was recorded in late 2024. Luckily, there haven't been any US Civil War updates since then, so the episode's content still holds up. Enjoy! During paternity leave, the new influx o...

21 Aug 1h 32min

North Korea's Messiah

Why is North Korea so weird? Is it Stalinism? Maoism? Japan-style emperor worship? Ancient Korean hermit kingdom energy? No, argues Jonathan Cheng, Beijing bureau chief for The Wall Street Journal and...

19 Aug 1h 59min

The Rise of China’s Electric Vehicle Industry

How did China grow its EV industry? Hint: it wasn’t really central planning from Beijing. It was a magical concoction of entrepreneurs and local officials using their guanxi to dance around giant SOEs...

17 Aug 1h 54min

China's Best Music in 2026 (So Far)

Jake Newby is the author of the Concrete Avalanche Substack, which covers the best music coming out of China. If you enjoy this playlist, check out Jake’s sets from 2025, 2024, and 2023, as well as hi...

14 Aug 54min