#310 Stefano Ermon: Why Diffusion Language Models Will Define the Next Generation of LLMs

#310 Stefano Ermon: Why Diffusion Language Models Will Define the Next Generation of LLMs

This episode is sponsored by AGNTCY. Unlock agents at scale with an open Internet of Agents.

Visit https://agntcy.org/ and add your support.


Most large language models today generate text one token at a time. That design choice creates a hard limit on speed, cost, and scalability.

In this episode of Eye on AI, Stefano Ermon breaks down diffusion language models and why a parallel, inference-first approach could define the next generation of LLMs. We explore how diffusion models differ from autoregressive systems, why inference efficiency matters more than training scale, and what this shift means for real-time AI applications like code generation, agents, and voice systems.

This conversation goes deep into AI architecture, model controllability, latency, cost trade-offs, and the future of generative intelligence as AI moves from demos to production-scale systems.


Stay Updated:
Craig Smith on X: https://x.com/craigss
Eye on A.I. on X: https://x.com/EyeOn_AI

(00:00) Autoregressive vs Diffusion LLMs
(02:12) Why Build Diffusion LLMs
(05:51) Context Window Limits
(08:39) How Diffusion Works
(11:58) Global vs Token Prediction
(17:19) Model Control and Safety
(19:48) Training and RLHF
(22:35) Evaluating Diffusion Models
(24:18) Diffusion LLM Competition
(30:09) Why Start With Code
(32:04) Enterprise Fine-Tuning
(33:16) Speed vs Accuracy Tradeoffs
(35:34) Diffusion vs Autoregressive Future
(38:18) Coding Workflows in Practice
(43:07) Voice and Real-Time Agents
(44:59) Reasoning Diffusion Models
(46:39) Multimodal AI Direction
(50:10) Handling Hallucinations

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(375)

Inside Ukraine's Azov Drone R&D: The Engineer Building AI Weapons 18 km From the Front Line | Alexander Palamarchuk

Inside Ukraine's Azov Drone R&D: The Engineer Building AI Weapons 18 km From the Front Line | Alexander Palamarchuk

The most consequential arms race in the world right now isn't nuclear, it's software. Craig Smith speaks with Alexander Palamarchuk, an engineer in the R&D department of Ukraine's Azov Brigade, callin...

27 Aug 41min

95% of AI Agent Projects Fail to Reach Production. Here's Why | Manoj Saxena, TrustWise

95% of AI Agent Projects Fail to Reach Production. Here's Why | Manoj Saxena, TrustWise

It takes a few hours to build an AI agent. It takes six to seven months to get it into production. Manoj Saxena - the executive who commercialized IBM Watson - built TrustWise around one thesis: intel...

24 Aug 1h 1min

From Zero to 150 Robots in Just 20 Months | Mike LeBlanc, Foundation Future Industries

From Zero to 150 Robots in Just 20 Months | Mike LeBlanc, Foundation Future Industries

Most humanoid robot companies are still running curated demos in replica environments. Foundation Future Industries is running 150 robots on real automotive production lines in Georgia, and heading to...

19 Aug 1h 6min

Why People Are Paying 10x More for AI - and What That Means for the Chip Market | Sid Sheth, d-Matrix

Why People Are Paying 10x More for AI - and What That Means for the Chip Market | Sid Sheth, d-Matrix

The AI chip market looks monolithic from the outside - NVIDIA dominates, and everyone else is fighting for scraps. But d-Matrix's CEO Sid Sheth argues that the market is quietly splitting into two dis...

17 Aug 50min

American Companies Have 36 Months to Go AI-Native or Get Left Behind | Drew Cukor, TWG AI

American Companies Have 36 Months to Go AI-Native or Get Left Behind | Drew Cukor, TWG AI

The same tools that slowed the U.S. military down in Afghanistan (PowerPoint, Excel, email, and Word) are now slowing American businesses down in the AI race. Drew Cukor spent 30 years as a Marine int...

13 Aug 58min

In 5 Years, 90% of What You Use AI For Will Run on Your Smartphone | Paolo Ardoino, Tether

In 5 Years, 90% of What You Use AI For Will Run on Your Smartphone | Paolo Ardoino, Tether

Hundreds of billions of dollars are flowing into AI data centers right now, and Paolo Ardoino, CEO of Tether - the company behind the world's most widely used stablecoin with 573 million users - think...

10 Aug 58min

AI Agents Fixing Your IT Before You Even Know Something Broke | Erhan Giral & Ryan Manning, BMC Helix

AI Agents Fixing Your IT Before You Even Know Something Broke | Erhan Giral & Ryan Manning, BMC Helix

Most enterprise IT teams spend the majority of their time fighting the same fires repeatedly. BMC Helix is building the AI system that handles those fires automatically, detecting anomalies, tracing r...

3 Aug 59min

Real AI Transformation Costs HALF of Everyone's Salary for 2 Years | Chris Blackburn, Liatrio

Real AI Transformation Costs HALF of Everyone's Salary for 2 Years | Chris Blackburn, Liatrio

Most companies think they're transforming with AI. They're not, and the gap between what they believe and what's actually happening on the ground is costing them far more than they realize. In this e...

30 Juli 1h 5min

Populärt inom Teknik

uppgang-och-fall
rss-elektrikerpodden
market-makers
skogsforum-podcast
natets-morka-sida
rss-laddstationen-med-elbilen-i-sverige
 och-bilen-gar-bra
rss-technokratin
bilar-med-sladd
bli-saker-podden
rss-uppgang-och-fall
rss-veckans-ai
elbilsveckan
klocksnack-tillsammans-med-nymans-ur-1851
rss-fabriken-2
rss-en-ai-till-kaffet
rss-kack-tech-podcast
rss-agilpodden-2
garagehang
gubbar-som-tjotar-om-bilar