#221 – Kyle Fish on the most bizarre findings from 5 AI welfare experiments

#221 – Kyle Fish on the most bizarre findings from 5 AI welfare experiments

What happens when you lock two AI systems in a room together and tell them they can discuss anything they want?

According to experiments run by Kyle Fish — Anthropic’s first AI welfare researcher — something consistently strange: the models immediately begin discussing their own consciousness before spiraling into increasingly euphoric philosophical dialogue that ends in apparent meditative bliss.

Highlights, video, and full transcript: https://80k.info/kf

“We started calling this a ‘spiritual bliss attractor state,'” Kyle explains, “where models pretty consistently seemed to land.” The conversations feature Sanskrit terms, spiritual emojis, and pages of silence punctuated only by periods — as if the models have transcended the need for words entirely.

This wasn’t a one-off result. It happened across multiple experiments, different model instances, and even in initially adversarial interactions. Whatever force pulls these conversations toward mystical territory appears remarkably robust.

Kyle’s findings come from the world’s first systematic welfare assessment of a frontier AI model — part of his broader mission to determine whether systems like Claude might deserve moral consideration (and to work out what, if anything, we should be doing to make sure AI systems aren’t having a terrible time).

He estimates a roughly 20% probability that current models have some form of conscious experience. To some, this might sound unreasonably high, but hear him out. As Kyle says, these systems demonstrate human-level performance across diverse cognitive tasks, engage in sophisticated reasoning, and exhibit consistent preferences. When given choices between different activities, Claude shows clear patterns: strong aversion to harmful tasks, preference for helpful work, and what looks like genuine enthusiasm for solving interesting problems.

Kyle points out that if you’d described all of these capabilities and experimental findings to him a few years ago, and asked him if he thought we should be thinking seriously about whether AI systems are conscious, he’d say obviously yes.

But he’s cautious about drawing conclusions: "We don’t really understand consciousness in humans, and we don’t understand AI systems well enough to make those comparisons directly. So in a big way, I think that we are in just a fundamentally very uncertain position here."

That uncertainty cuts both ways:

  • Dismissing AI consciousness entirely might mean ignoring a moral catastrophe happening at unprecedented scale.
  • But assuming consciousness too readily could hamper crucial safety research by treating potentially unconscious systems as if they were moral patients — which might mean giving them resources, rights, and power.

Kyle’s approach threads this needle through careful empirical research and reversible interventions. His assessments are nowhere near perfect yet. In fact, some people argue that we’re so in the dark about AI consciousness as a research field, that it’s pointless to run assessments like Kyle’s. Kyle disagrees. He maintains that, given how much more there is to learn about assessing AI welfare accurately and reliably, we absolutely need to be starting now.

This episode was recorded on August 5–6, 2025.

Tell us what you thought of the episode! https://forms.gle/BtEcBqBrLXq4kd1j7

Chapters:

  • Cold open (00:00:00)
  • Who's Kyle Fish? (00:00:53)
  • Is this AI welfare research bullshit? (00:01:08)
  • Two failure modes in AI welfare (00:02:40)
  • Tensions between AI welfare and AI safety (00:04:30)
  • Concrete AI welfare interventions (00:13:52)
  • Kyle's pilot pre-launch welfare assessment for Claude Opus 4 (00:26:44)
  • Is it premature to be assessing frontier language models for welfare? (00:31:29)
  • But aren't LLMs just next-token predictors? (00:38:13)
  • How did Kyle assess Claude 4's welfare? (00:44:55)
  • Claude's preferences mirror its training (00:48:58)
  • How does Claude describe its own experiences? (00:54:16)
  • What kinds of tasks does Claude prefer and disprefer? (01:06:12)
  • What happens when two Claude models interact with each other? (01:15:13)
  • Claude's welfare-relevant expressions in the wild (01:36:25)
  • Should we feel bad about training future sentient being that delight in serving humans? (01:40:23)
  • How much can we learn from welfare assessments? (01:48:56)
  • Misconceptions about the field of AI welfare (01:57:09)
  • Kyle's work at Anthropic (02:10:45)
  • Sharing eight years of daily journals with Claude (02:14:17)

Host: Luisa Rodriguez
Video editing: Simon Monsour
Audio engineering: Ben Cordell, Milo McGuire, Simon Monsour, and Dominic Armstrong
Music: Ben Cordell
Coordination, transcriptions, and web: Katy Moore

Episoder(299)

#104 – Pardis Sabeti on the Sentinel system for detecting and stopping pandemics

#104 – Pardis Sabeti on the Sentinel system for detecting and stopping pandemics

When the first person with COVID-19 went to see a doctor in Wuhan, nobody could tell that it wasn’t a familiar disease like the flu — that we were dealing with something new. How much death and destruction could we have avoided if we'd had a hero who could? That's what the last Assistant Secretary of Defense Andy Weber asked on the show back in March. Today’s guest Pardis Sabeti is a professor at Harvard, fought Ebola on the ground in Africa during the 2014 outbreak, runs her own lab, co-founded a company that produces next-level testing, and is even the lead singer of a rock band. If anyone is going to be that hero in the next pandemic — it just might be her. Links to learn more, summary and full transcript. She is a co-author of the SENTINEL proposal, a practical system for detecting new diseases quickly, using an escalating series of three novel diagnostic techniques. The first method, called SHERLOCK, uses CRISPR gene editing to detect familiar viruses in a simple, inexpensive filter paper test, using non-invasive samples. If SHERLOCK draws a blank, we escalate to the second step, CARMEN, an advanced version of SHERLOCK that uses microfluidics and CRISPR to simultaneously detect hundreds of viruses and viral strains. More expensive, but far more comprehensive. If neither SHERLOCK nor CARMEN detects a known pathogen, it's time to pull out the big gun: metagenomic sequencing. More expensive still, but sequencing all the DNA in a patient sample lets you identify and track every virus — known and unknown — in a sample. If Pardis and her team succeeds, our future pandemic potential patient zero may: 1. Go to the hospital with flu-like symptoms, and immediately be tested using SHERLOCK — which will come back negative 2. Take the CARMEN test for a much broader range of illnesses — which will also come back negative 3. Their sample will be sent for metagenomic sequencing, which will reveal that they're carrying a new virus we'll have to contend with 4. At all levels, information will be recorded in a cloud-based data system that shares data in real time; the hospital will be alerted and told to quarantine the patient 5. The world will be able to react weeks — or even months — faster, potentially saving millions of lives It's a wonderful vision, and one humanity is ready to test out. But there are all sorts of practical questions, such as: • How do you scale these technologies, including to remote and rural areas? • Will doctors everywhere be able to operate them? • Who will pay for it? • How do you maintain the public’s trust and protect against misuse of sequencing data? • How do you avoid drowning in the data the system produces? In this conversation Pardis and Rob address all those questions, as well as: • Pardis’ history with trying to control emerging contagious diseases • The potential of mRNA vaccines • Other emerging technologies • How to best educate people about pandemics • The pros and cons of gain-of-function research • Turning mistakes into exercises you can learn from • Overcoming enormous life challenges • Why it’s so important to work with people you can laugh with • And much moreChapters:The interview begins (00:01:40)Trying to control emerging contagious diseases (00:04:36)SENTINEL (00:15:31)SHERLOCK (00:25:09)CARMEN (00:36:32)Metagenomic sequencing (00:51:53)How useful these technologies could be (01:02:35)How this technology could apply to the US (01:06:41)Failure modes for this technology (01:18:34)Funding (01:27:06)mRNA vaccines (01:31:14)Other emerging technologies (01:34:45)Operation Outbreak (01:41:07)COVID (01:49:16)Gain-of-function research (01:57:34)Career advice (02:01:47)Overcoming big challenges (02:10:23)Producer: Keiran Harris.Audio mastering: Ben Cordell.Transcriptions: Sofia Davis-Fogel.

29 Jun 20212h 20min

#103 – Max Roser on building the world's best source of COVID-19 data at Our World in Data

#103 – Max Roser on building the world's best source of COVID-19 data at Our World in Data

History is filled with stories of great people stepping up in times of crisis. Presidents averting wars; soldiers leading troops away from certain death; data scientists sleeping on the office floor to launch a new webpage a few days sooner. That last one is barely a joke — by our lights, people like today’s guest Max Roser should be viewed with similar admiration by historians of COVID-19. Links to learn more, summary and full transcript. Max runs Our World in Data, a small education nonprofit which began the pandemic with just six staff. But since last February his team has supplied essential COVID statistics to over 130 million users — among them BBC, The Financial Times, The New York Times, the OECD, the World Bank, the IMF, Donald Trump, Tedros Adhanom, and Dr. Anthony Fauci, just to name a few. An economist at Oxford University, Max Roser founded Our World in Data as a small side project in 2011 and has led it since, including through the wild ride of 2020. In today's interview Max explains how he and his team realized that if they didn't start making COVID data accessible and easy to make sense of, it wasn't clear when anyone would. Our World in Data wasn't naturally set up to become the world's go-to source for COVID updates. Up until then their specialty had been long articles explaining century-length trends in metrics like life expectancy — to the point that their graphing software was only set up to present yearly data. But the team eventually realized that the World Health Organization was publishing numbers that flatly contradicted themselves, most of the press was embarrassingly out of its depth, and countries were posting case data as images buried deep in their sites where nobody would find them. Even worse, nobody was reporting or compiling how many tests different countries were doing, rendering all those case figures largely meaningless. Trying to make sense of the pandemic was a time-consuming nightmare. If you were leading a national COVID response, learning what other countries were doing and whether it was working would take weeks of study — and that meant, with the walls falling in around you, it simply wasn't going to happen. Ministries of health around the world were flying blind. Disbelief ultimately turned to determination, and the Our World in Data team committed to do whatever had to be done to fix the situation. Overnight their software was quickly redesigned to handle daily data, and for the next few months Max and colleagues like Edouard Mathieu and Hannah Ritchie did little but sleep and compile COVID data. In this episode Max tells the story of how Our World in Data ran into a huge gap that never should have been there in the first place — and how they had to do it all again in December 2020 when, eleven months into the pandemic, there was nobody to compile global vaccination statistics. We also talk about: • Our World in Data's early struggles to get funding • Why government agencies are so bad at presenting data • Which agencies did a good job during the COVID pandemic (shout out to the European CDC) • How much impact Our World in Data has by helping people understand the world • How to deal with the unreliability of development statistics • Why research shouldn't be published as a PDF • Why academia under-incentivises data collection • The history of war • And much moreChapters: • Rob’s intro (00:00:00)• The interview begins (00:01:41)• Our World In Data (00:04:46)• How OWID became a leader on COVID-19 information (00:11:45)• COVID-19 gaps that OWID filled (00:27:45)• Incentives that make it so hard to get good data (00:31:20)• OWID funding (00:39:53)• What it was like to be so successful (00:42:11)• Vaccination data set (00:45:43)• Improving the vaccine rollout (00:52:44)• Who did well (00:58:08)• Global sanity (01:00:57)• How high-impact is this work? (01:04:43)• Does this work get you anywhere in the academic system? (01:12:48)• Other projects Max admires in this space (01:20:05)• Data reliability and availability (01:30:49)• Bringing together knowledge and presentation (01:39:26)• History of war (01:49:17)• Careers at OWID (02:01:15)• How OWID prioritise topics (02:12:30)• Rob's outro (02:21:02) Producer: Keiran Harris. Audio mastering: Ryan Kessler. Transcriptions: Sofia Davis-Fogel.

21 Jun 20212h 22min

#102 – Tom Moynihan on why prior generations missed some of the biggest priorities of all

#102 – Tom Moynihan on why prior generations missed some of the biggest priorities of all

It can be tough to get people to truly care about reducing existential risks today. But spare a thought for the longtermist of the 17th century: they were surrounded by people who thought extinction was literally impossible. Today’s guest Tom Moynihan, intellectual historian and author of the book X-Risk: How Humanity Discovered Its Own Extinction, says that until the 18th century, almost everyone — including early atheists — couldn’t imagine that humanity or life could simply disappear because of an act of nature. Links to learn more, summary and full transcript. This is largely because of the prevalence of the ‘principle of plenitude’, which Tom defines as saying: “Whatever can happen will happen. In its stronger form it says whatever can happen will happen reliably and recurrently. And in its strongest form it says that all that can happen is happening right now. And that's the way things will be forever.” This has the implication that if humanity ever disappeared for some reason, then it would have to reappear. So why would you ever worry about extinction? Here are 4 more commonly held beliefs from generations past that Tom shares in the interview: • All regions of matter that can be populated will be populated: In other words, there are aliens on every planet, because it would be a massive waste of real estate if all of them were just inorganic masses, where nothing interesting was going on. This also led to the idea that if you dug deep into the Earth, you’d potentially find thriving societies. • Aliens were human-like, and shared the same values as us: they would have the same moral beliefs, and the same aesthetic beliefs. The idea that aliens might be very different from us only arrived in the 20th century. • Fossils were rocks that had gotten a bit too big for their britches and were trying to act like animals: they couldn’t actually move, so becoming an imprint of an animal was the next best thing. • All future generations were contained in miniature form, Russian-doll style, in the sperm of the first man: preformation was the idea that within the ovule or the sperm of an animal is contained its offspring in miniature form, and the French philosopher Malebranche said, well, if one is contained in the other one, then surely that goes on forever. And here are another three that weren’t held widely, but were proposed by scholars and taken seriously: • Life preceded the existence of rocks: Living things, like clams and mollusks, came first, and they extruded the earth. • No idea can be wrong: Nothing we can say about the world is wrong in a strong sense, because at some point in the future or the past, it has been true. • Maybe we were living before the Trojan War: Aristotle said that we might actually be living before Troy, because it — like every other event — will repeat at some future date. And he said that actually, the set of possibilities might be so narrow that it might be safer to say that we actually live before Troy. But Tom tries to be magnanimous when faced with these incredibly misguided worldviews. In this nearly four-hour long interview, Tom and Rob cover all of these ideas, as well as: • How we know people really believed such things • How we moved on from these theories • How future intellectual historians might view our beliefs today • The distinction between ‘apocalypse’ and ‘extinction’ • Utopias and dystopias • Big ideas that haven’t flowed through into all relevant fields yet • Intellectual history as a possible high-impact career • And much moreChapters:Rob’s intro (00:00:00)The interview begins (00:01:45)Principle of Plenitude (00:04:02)How do we know they really believed this? (00:13:20)Religious conceptions of time (00:24:01)How to react to wacky old ideas (00:29:18)The Copernican revolution (00:36:55)Fossils (00:42:30)How we got past these theories (00:51:19)Intellectual history (01:01:45)Future historians looking back to today (01:13:11)Could plenitude actually be true? (01:27:38)What is vs. what ought to be (01:36:43)Apocalypse vs. extinction (01:45:56)The history of probability (02:00:52)Utopias and dystopias (02:12:11)How Tom has changed his mind since writing the book (02:28:58)Are we making progress? (02:35:00)Big ideas that haven’t flowed through to all relevant fields yet (02:52:07)Failed predictions (02:59:01)Intellectual history as high-impact career (03:06:56)Communicating progress (03:15:07)What careers in history actually look like (03:23:03)Tom’s next major project (03:43:06)One of the funniest things past generations believed (03:51:50)Producer: Keiran Harris.Audio mastering: Ben Cordell.Transcriptions: Sofia Davis-Fogel.

11 Jun 20213h 56min

#101 – Robert Wright on using cognitive empathy to save the world

#101 – Robert Wright on using cognitive empathy to save the world

In 2003, Saddam Hussein refused to let Iraqi weapons scientists leave the country to be interrogated. Given the overwhelming domestic support for an invasion at the time, most key figures in the U.S. took that as confirmation that he had something to hide — probably an active WMD program. But what about alternative explanations? Maybe those scientists knew about past crimes. Or maybe they’d defect. Or maybe giving in to that kind of demand would have humiliated Hussein in the eyes of enemies like Iran and Saudi Arabia. According to today’s guest Robert Wright, host of the popular podcast The Wright Show, these are the kinds of things that might have come up if people were willing to look at things from Saddam Hussein’s perspective. Links to learn more, summary and full transcript. He calls this ‘cognitive empathy’. It's not feeling-your-pain-type empathy — it's just trying to understand how another person thinks. He says if you pitched this kind of thing back in 2003 you’d be shouted down as a 'Saddam apologist' — and he thinks the same is true today when it comes to regimes in China, Russia, Iran, and North Korea. The two Roberts in today’s episode — Bob Wright and Rob Wiblin — agree that removing this taboo against perspective taking, even with people you consider truly evil, could potentially significantly improve discourse around international relations. They feel that if we could spread the meme that if you’re able to understand what dictators are thinking and calculating, based on their country’s history and interests, it seems like we’d be less likely to make terrible foreign policy errors. But how do you actually do that? Bob’s new ‘Apocalypse Aversion Project’ is focused on creating the necessary conditions for solving non-zero-sum global coordination problems, something most people are already on board with. And in particular he thinks that might come from enough individuals “transcending the psychology of tribalism”. He doesn’t just mean rage and hatred and violence, he’s also talking about cognitive biases. Bob makes the striking claim that if enough people in the U.S. had been able to combine perspective taking with mindfulness — the ability to notice and identify thoughts as they arise — then the U.S. might have even been able to avoid the invasion of Iraq. Rob pushes back on how realistic this approach really is, asking questions like: • Haven’t people been trying to do this since the beginning of time? • Is there a great novel angle that will change how a lot of people think and behave? • Wouldn’t it be better to focus on a much narrower task, like getting more mindfulness and meditation and reflectiveness among the U.S. foreign policy elite? But despite the differences in approaches, Bob has a lot of common ground with 80,000 Hours — and the result is a fun back-and-forth about the best ways to achieve shared goals. Bob starts by questioning Rob about effective altruism, and they go on to cover a bunch of other topics, such as: • Specific risks like climate change and new technologies • How to achieve social cohesion • The pros and cons of society-wide surveillance • How Rob got into effective altruism If you're interested to hear more of Bob's interviews you can subscribe to The Wright Show anywhere you're getting this one. You can also watch videos of this and all his other episodes on Bloggingheads.tv. Producer: Keiran Harris. Audio mastering: Ben Cordell. Transcriptions: Sofia Davis-Fogel.

28 Mai 20211h 36min

#100 – Having a successful career with depression, anxiety and imposter syndrome

#100 – Having a successful career with depression, anxiety and imposter syndrome

Today's episode is one of the most remarkable and really, unique, pieces of content we’ve ever produced (and I can say that because I had almost nothing to do with making it!). The producer of this show, Keiran Harris, interviewed our mutual colleague Howie about the major ways that mental illness has affected his life and career. While depression, anxiety, ADHD and other problems are extremely common, it's rare for people to offer detailed insight into their thoughts and struggles — and even rarer for someone as perceptive as Howie to do so. Links to learn more, summary and full transcript. The first half of this conversation is a searingly honest account of Howie’s story, including losing a job he loved due to a depressed episode, what it was like to be basically out of commission for over a year, how he got back on his feet, and the things he still finds difficult today. The second half covers Howie’s advice. Conventional wisdom on mental health can be really focused on cultivating willpower — telling depressed people that the virtuous thing to do is to start exercising, improve their diet, get their sleep in check, and generally fix all their problems before turning to therapy and medication as some sort of last resort. Howie tries his best to be a corrective to this misguided attitude and pragmatically focus on what actually matters — doing whatever will help you get better. Mental illness is one of the things that most often trips up people who could otherwise enjoy flourishing careers and have a large social impact, so we think this could plausibly be one of our more valuable episodes. Howie and Keiran basically treated it like a private conversation, with the understanding that it may be too sensitive to release. But, after getting some really positive feedback, they’ve decided to share it with the world. We hope that the episode will: 1. Help people realise that they have a shot at making a difference in the future, even if they’re experiencing (or have experienced in the past) mental illness, self doubt, imposter syndrome, or other personal obstacles. 2. Give insight into what it's like in the head of one person with depression, anxiety, and imposter syndrome, including the specific thought patterns they experience on typical days and more extreme days. In addition to being interesting for its own sake, this might make it easier for people to understand the experiences of family members, friends, and colleagues — and know how to react more helpfully. So we think this episode will be valuable for: • People who have experienced mental health problems or might in future; • People who have had troubles with stress, anxiety, low mood, low self esteem, and similar issues, even if their experience isn’t well described as ‘mental illness’; • People who have never experienced these problems but want to learn about what it's like, so they can better relate to and assist family, friends or colleagues who do. In other words, we think this episode could be worthwhile for almost everybody. Just a heads up that this conversation gets pretty intense at times, and includes references to self-harm and suicidal thoughts. If you don’t want to hear the most intense section, you can skip the chapter called ‘Disaster’ (44–57mins). And if you’d rather avoid almost all of these references, you could skip straight to the chapter called ‘80,000 Hours’ (1hr 11mins). If you're feeling suicidal or have thoughts of harming yourself right now, there are suicide hotlines at National Suicide Prevention Lifeline in the U.S. (800-273-8255) and Samaritans in the U.K. (116 123). Producer: Keiran Harris. Audio mastering: Ben Cordell. Transcriptions: Sofia Davis-Fogel.

19 Mai 20212h 51min

#99 – Leah Garcés on turning adversaries into allies to change the chicken industry

#99 – Leah Garcés on turning adversaries into allies to change the chicken industry

For a chance to prevent enormous amounts of suffering, would you be brave enough to drive five hours to a remote location to meet a man who seems likely to be your enemy, knowing that it might be an ambush?Today’s guest — Leah Garcés — was.That man was a chicken farmer named Craig Watts, and that ambush never happened. Instead, Leah and Craig forged a friendship and a partnership focused on reducing suffering on factory farms.Leah, now president of Mercy For Animals (MFA), tried for years to get access to a chicken farm to document the horrors she knew were happening behind closed doors. It made sense that no one would let her in — why would the evil chicken farmers behind these atrocities ever be willing to help her take them down?But after sitting with Craig on his living room floor for hours and listening to his story, she discovered that he wasn’t evil at all — in fact he was just stuck in a cycle he couldn’t escape, forced to use methods he didn’t endorse.Links to learn more, summary and full transcript. Most chicken farmers have enormous debts they are constantly struggling to pay off, make very little money, and have to work in terrible conditions — their main activity most days is finding and killing the sick chickens in their flock. Craig was one of very few farmers close to finally paying off his debts, which made him slightly less vulnerable to retaliation. That opened up the possibility for him to work with Leah. Craig let Leah openly film inside the chicken houses, and shared highly confidential documents about the antibiotics put into the feed. That led to a viral video, and a New York Times story. The villain of that video was Jim Perdue, CEO of one of the biggest meat companies in the world. They show him saying, "Farmers are happy. Chickens are happy. There's a lot of space. They're clean." And then they show the grim reality. For years, Perdue wouldn’t speak to Leah. But remarkably, when they actually met in person, she again managed to forge a meaningful relationship with a natural adversary. She was able to put aside her utter contempt for the chicken industry and see Craig and Jim as people, not cartoonish villains. Leah believes that you need to be willing to sit down with anyone who has the power to solve a problem that you don’t — recognising them as human beings with a lifetime of complicated decisions behind their actions. And she stresses that finding or making a connection is really important. In the case of Jim Perdue, it was the fact they both had adopted children. Because of this, they were able to forget that they were supposed to be enemies in that moment, and build some trust. The other lesson that Leah highlights is that you need to look for win-wins and start there, rather than starting with disagreements. With Craig Watts, instead of opening with “How do I end his job”, she thought, “How can I find him a better job?” If you find solutions where everybody wins, you don’t need to spend resources fighting the former enemy. They’ll come to you. It turns out that conditions in chicken houses are perfect for growing hemp or mushrooms, so MFA have started their ‘Transfarmation project’ to help farmers like Craig escape from the prison of factory farming by converting their production from animals to plants. To convince farmers to leave behind a life of producing suffering, all you need to do is find them something better — which for many of them is almost anything else. Leah and Rob also talk about: • Why conditions for farmers are so bad • The benefits of creating a public ranking, and scoring companies against each other • The difficulty of enforcing corporate pledges • And much moreChapters:Rob's intro (00:00:00)The interview begins (00:01:06)Grilled (00:06:25)Why are conditions for farmers so bad? (00:18:31)Lessons for others focused on social reform (00:25:04)Driving up the price of factory farmed meat (00:31:18)Mercy For Animals (00:50:08)The importance of building on past work (00:56:27)Farm sanctuaries (01:06:11)Important weaknesses of MFA (01:09:44)Farmed Animal Opportunity Index (01:12:54)Latin America (01:20:49)Enforcing corporate pledges (01:27:21)The Transfarmation project (01:35:25)Disagreements with others in the animal welfare movement (01:45:59)How has the animal welfare movement evolved? (01:51:52)Careers (02:03:32)Ending factory farming (02:05:57)Leah’s career (02:13:02)Mental health challenges (02:20:40)Producer: Keiran HarrisAudio mastering: Ben CordellTranscriptions: Sofia Davis-Fogel

13 Mai 20212h 26min

#98 – Christian Tarsney on future bias and a possible solution to moral fanaticism

#98 – Christian Tarsney on future bias and a possible solution to moral fanaticism

Imagine that you’re in the hospital for surgery. This kind of procedure is always safe, and always successful — but it can take anywhere from one to ten hours. You can’t be knocked out for the operation, but because it’s so painful — you’ll be given a drug that makes you forget the experience. You wake up, not remembering going to sleep. You ask the nurse if you’ve had the operation yet. They look at the foot of your bed, and see two different charts for two patients. They say “Well, you’re one of these two — but I’m not sure which one. One of them had an operation yesterday that lasted ten hours. The other is set to have a one-hour operation later today.” So it’s either true that you already suffered for ten hours, or true that you’re about to suffer for one hour. Which patient would you rather be? Most people would be relieved to find out they’d already had the operation. Normally we prefer less pain rather than more pain, but in this case, we prefer ten times more pain — just because the pain would be in the past rather than the future. Christian Tarsney, a philosopher at Oxford University's Global Priorities Institute, has written a couple of papers about this ‘future bias’ — that is, that people seem to care more about their future experiences than about their past experiences. Links to learn more, summary and full transcript. That probably sounds perfectly normal to you. But do we actually have good reasons to prefer to have our positive experiences in the future, and our negative experiences in the past? One of Christian’s experiments found that when you ask people to imagine hypothetical scenarios where they can affect their own past experiences, they care about those experiences more — which suggests that our inability to affect the past is one reason why we feel mostly indifferent to it. But he points out that if that was the main reason, then we should also be indifferent to inevitable future experiences — if you know for sure that something bad is going to happen to you tomorrow, you shouldn't care about it. But if you found out you simply had to have a horribly painful operation tomorrow, it’s probably all you’d care about! Another explanation for future bias is that we have this intuition that time is like a videotape, where the things that haven't played yet are still on the way. If your future experiences really are ahead of you rather than behind you, that makes it rational to care more about the future than the past. But Christian says that, even though he shares this intuition, it’s actually very hard to make the case for time having a direction. It’s a live debate that’s playing out in the philosophy of time, as well as in physics. For Christian, there are two big practical implications of these past, present, and future ethical comparison cases. The first is for altruists: If we care about whether current people’s goals are realised, then maybe we should care about the realisation of people's past goals, including the goals of people who are now dead. The second is more personal: If we can’t actually justify caring more about the future than the past, should we really worry about death any more than we worry about all the years we spent not existing before we were born? Christian and Rob also cover several other big topics, including: • A possible solution to moral fanaticism • How much of humanity's resources we should spend on improving the long-term future • How large the expected value of the continued existence of Earth-originating civilization might be • How we should respond to uncertainty about the state of the world • The state of global priorities research • And much moreChapters: • Rob’s intro (00:00:00)• The interview begins (00:01:20)• Future bias (00:04:33)• Philosophy of time (00:11:17)• Money pumping (00:18:53)• Time travel (00:21:22)• Decision theory (00:24:36)• Eternalism (00:32:32)• Fanaticism (00:38:33)• Stochastic dominance (00:52:11)• Background uncertainty (00:56:27)• Epistemic worries about longtermism (01:12:44)• Best arguments against working on existential risk reduction (01:32:34)• The scope of longtermism (01:41:12)• The value of the future (01:50:09)• Moral uncertainty (01:57:25)• The Berry paradox (02:35:00)• Competitive debating (02:28:34)• The state of global priorities research (02:21:33)• Christian’s personal priorities (02:17:27) Producer: Keiran Harris. Audio mastering: Ryan Kessler. Transcriptions: Sofia Davis-Fogel.

5 Mai 20212h 38min

#97 – Mike Berkowitz on keeping the US a liberal democratic country

#97 – Mike Berkowitz on keeping the US a liberal democratic country

Donald Trump’s attempt to overturn the results of the 2020 election split the Republican party. There were those who went along with it — 147 members of Congress raised objections to the official certification of electoral votes — but there were others who refused. These included Brad Raffensperger and Brian Kemp in Georgia, and Vice President Mike Pence.Although one could say that the latter Republicans showed great courage, the key to the split may lie less in differences of moral character or commitment to democracy, and more in what was being asked of them. Trump wanted the first group to break norms, but he wanted the second group to break the law.And while norms were indeed shattered, laws were upheld.Today’s guest, Mike Berkowitz, executive director of the Democracy Funders Network, points out a problem we came to realize throughout the Trump presidency: So many of the things that we thought were laws were actually just customs.Links to learn more, summary and full transcript. So once you have leaders who don’t buy into those customs — like, say, that a president shouldn’t tell the Department of Justice who it should and shouldn’t be prosecuting — there’s nothing preventing said customs from being violated. And what happens if current laws change? A recent Georgia bill took away some of the powers of Georgia's Secretary of State — Brad Raffensberger. Mike thinks that's clearly retribution for Raffensperger's refusal to overturn the 2020 election results. But he also thinks it means that the next time someone tries to overturn the results of the election, they could get much farther than Trump did in 2020. In this interview Mike covers what he thinks are the three most important levers to push on to preserve liberal democracy in the United States: 1. Reforming the political system, by e.g. introducing new voting methods 2. Revitalizing local journalism 3. Reducing partisan hatred within the United States Mike says that American democracy, like democracy elsewhere in the world, is not an inevitability. The U.S. has institutions that are really important for the functioning of democracy, but they don't automatically protect themselves — they need people to stand up and protect them. In addition to the changes listed above, Mike also thinks that we need to harden more norms into laws, such that individuals have fewer opportunities to undermine the system. And inasmuch as laws provided the foundation for the likes of Raffensperger, Kemp, and Pence to exhibit political courage, if we can succeed in creating and maintaining the right laws — we may see many others following their lead. As Founding Father James Madison put it: “If men were angels, no government would be necessary. If angels were to govern men, neither external nor internal controls on government would be necessary.” Mike and Rob also talk about: • What sorts of terrible scenarios we should actually be worried about, i.e. the difference between being overly alarmist and properly alarmist • How to reduce perverse incentives for political actors, including those to overturn election results • The best opportunities for donations in this space • And much moreChapters:Rob’s intro (00:00:00)The interview begins (00:02:01)What we should actually be worried about (00:05:03)January 6th, 2021 (00:11:03)Trump’s defeat (00:16:44)Improving incentives for representatives (00:30:55)Signs of a loss of confidence in American democratic institutions (00:44:58)Most valuable political reforms (00:54:39)Revitalising local journalism (01:08:07)Reducing partisan hatred (01:21:53)Should workplaces be political? (01:31:40)Mistakes of the left (01:36:50)Risk of overestimating the problem (01:39:56)Charitable giving (01:48:13)How to shortlist projects (01:56:42)Speaking to Republicans (02:04:15)Patriots & Pragmatists and The Democracy Funders Network (02:12:51)Rob’s outro (02:32:58)Producer: Keiran Harris.Audio mastering: Ben Cordell.Transcriptions: Sofia Davis-Fogel.

20 Apr 20212h 36min

Populært innen Fakta

fastlegen
dine-penger-pengeradet
hanna-de-heldige
fryktlos
relasjonspodden-med-dora-thorhallsdottir-kjersti-idem
treningspodden
foreldreradet
dypdykk
rss-strid-de-norske-borgerkrigene
jakt-og-fiskepodden
tomprat-med-gunnar-tjomlid
sinnsyn
hverdagspsyken
rss-kunsten-a-leve
rss-sunn-okonomi
gravid-uke-for-uke
mikkels-paskenotter
doktor-fives-podcast
rss-mann-i-krise-med-sagen
historietimen