AI Safety Language Is Destroying the Debate | Steven Sinofsky

a16z Board Partner and former Microsoft Windows president Steven Sinofsky joins Theo Jaffee and Sofia Puccini on MTS to argue that the language we use to describe AI failures is making it harder to understand what’s actually going wrong.

Steven takes aim at terms like “alignment,” “goal-seeking,” and “rogue agents,” arguing that they can anthropomorphize problems that software engineers have dealt with for decades. His framing is simpler: when software doesn’t do what it’s supposed to do, it has a bug. And as AI becomes more widely deployed, labs need the same kind of telemetry, debugging, incident reporting, and operational discipline that previous generations of software eventually developed.

Drawing on everything from early computer hacking and Microsoft’s response to major software failures to Y2K and cybersecurity standards, Steven makes the case for treating AI reliability as an engineering problem. They also discuss what AI labs can learn from CVE reporting, why industry has a responsibility to make its systems safer, and how confusing terminology can lead to equally confused regulation.

Resources:

Follow Steven Sinofsky on X: https://x.com/stevesi

Follow Theo Jaffee on X: https://x.com/theojaffee

Follow Sofia Puccini on X: https://x.com/schisofrenia

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.