275 - Nate Soares: AI Will Kill Us All If We Don’t Change Course

Nate Soares is the President of the Machine Intelligence Research Institute, and plays a central role in setting MIRI’s vision and strategy. Soares has been working in the field for over a decade, and is the author of a large body of technical and semi-technical writing on AI alignment, including foundational work on value learning, decision theory, and power-seeking incentives in smarter-than-human AIs. Prior to MIRI, Soares worked as an engineer at Google and Microsoft, as a research associate at the National Institute of Standards and Technology, and as a contractor for the US Department of Defense. In this episode, Nate and Robinson discuss the problems of AI from the ground up. They touch on how AI is trained, why it will surpass human intelligence, why this is dangerous, how it could wipe out humankind, and more. Nate’s recent book, co-written with Eliezer Yudkowsky, is If Anyone Builds It, Everyone Dies (Little, Brown and Company, 2025).

If Anyone Builds It, Everyone Dies

Nate’s X: https://x.com/So8res

MIRI: https://intelligence.org

OUTLINE

00:00 Nate’s Existential Dread

07:11 What’s the REAL Problem with Artificial Intelligence?

11:39 How Is AI Trained?

17:15 The Vital Importance of Interpreting AI

20:53 Why AI Will Soon Surpass Human Intelligence

32:58 Why Solving the AI Alignment Problem is Crucial to Human Survival

38:40 Will AI Render Human Software Engineers Obsolete?

48:03 Does It Make Sense to Say AI Has Goals?

01:00:02 Why AI Consciousness Is Unimportant

01:11:33 How, Realistically, Could AI Wipe Out Humanity?

01:35:27 A Sci-Fi (But Realistic) AI Doomsday Scenario

01:44:34 Is There Hope that Humans Will Survive AI?

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(295)

293 - Justin Wolfers: AI, Inflation, & The 2026 Elections

Platypus Economics on YouTube: https://www.youtube.com/@PlatypusEconomicsJustin Wolfers is Professor of Public Policy and Economics at the University of Michigan, where his research spans macroeconomi...

26 Sep 1h 3min

292 - Jason Stanley: Breaking Down Trump’s Propaganda

Jason Stanley is the Bissell-Heyd-Associates Chair in American Studies at the Munk School of Global Affairs & Public Policy at the University of Toronto, where he is also Professor of Philosophy. Befo...

23 Sep 1h 24min

291 - Daron Acemoglu: AI Is Destroying American Democracy

Daron Acemoglu is an Institute Professor of Economics at MIT and a recipient of the 2024 Nobel Memorial Prize in Economic Sciences, which he shared with Simon Johnson and James Robinson for research o...

20 Sep 1h

290 - Nicholas Humphrey: Why Does Beauty Exist?

Why Is the World So Beautiful?: https://a.co/d/0d3LsupANicholas Humphrey is a theoretical psychologist and Emeritus Professor of Psychology at the London School of Economics, where his work has focuse...

13 Sep 1h 17min

289 - Joe Henrich: How Culture Made Humans Weird

Joe Henrich is the Ruth Moore Professor of Biological Anthropology and Professor of Human Evolutionary Biology at Harvard University. His research focuses on cultural evolution, human psychology, soci...

6 Sep 1h 1min

288 - Richard Wrangham: How Humans Caught Fire

Richard Wrangham is the Ruth Moore Professor of Biological Anthropology, Emeritus, at Harvard University. A primatologist and biological anthropologist, he has studied wild chimpanzees in Uganda since...

30 Aug 1h 14min

287: Daniel Lieberman: Evolution and the Human Diet

Daniel Lieberman is the Edwin M. Lerner II Professor of Biological Sciences and Professor of Human Evolutionary Biology at Harvard University, where he studies the evolution of the human body and its ...

23 Aug 1h 12min

286: Adam Mockler: Trump, Newsom, and the Dark Future of American Politics

Adam Mockler is a liberal political commentator, YouTube host, and digital media creator who has become one of the most prominent Gen Z voices in American political media. He hosts The Adam Mockler Sh...

16 Aug 1h 2min