#323 David Ha: Why Model Merging Could Be the Next AI Breakthrough

#323 David Ha: Why Model Merging Could Be the Next AI Breakthrough

This episode is sponsored by tastytrade.
Trade stocks, options, futures, and crypto in one platform with low commissions and zero commission on stocks and crypto. Built for traders who think in probabilities, tastytrade offers advanced analytics, risk tools, and an AI-powered Search feature.

Learn more at https://tastytrade.com/



Artificial intelligence is reaching a turning point. Instead of building bigger and bigger models, what if the real breakthrough comes from letting AI evolve?


In this episode of Eye on AI, David Ha, Co-Founder and CEO of Sakana AI, explains why evolutionary strategies and collective intelligence could reshape the future of machine learning. We explore model merging, multi-agent systems, Monte Carlo tree search, and the AI Scientist framework designed to generate and evaluate new research ideas. The conversation dives into open-ended discovery, quality and diversity in AI systems, world models, and whether artificial intelligence can push beyond the boundaries of human knowledge.


If you're interested in AGI, evolutionary AI, frontier models, AI research automation, or how AI could start discovering science on its own, this episode offers a clear look at where the field may be heading next.


Stay Updated:

Craig Smith on X: https://x.com/craigss

Eye on A.I. on X: https://x.com/EyeOn_AI


(00:00) AI Should Evolve, Not Just Scale

(03:54) David's Journey From Finance to Evolutionary AI

(10:18) Why Gradient Descent Gets Stuck

(18:12) Model Merging and Collective Intelligence

(28:18) Combining Closed Frontier Models

(32:56) Inside the AI Scientist Experiment

(38:11) Parent Selection, Diversity and Innovation

(49:25) Can AI Discover Truly New Knowledge?

(53:05) Why Continual Learning Matter

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(374)

95% of AI Agent Projects Fail to Reach Production. Here's Why | Manoj Saxena, TrustWise

95% of AI Agent Projects Fail to Reach Production. Here's Why | Manoj Saxena, TrustWise

It takes a few hours to build an AI agent. It takes six to seven months to get it into production. Manoj Saxena - the executive who commercialized IBM Watson - built TrustWise around one thesis: intel...

24 Aug 1h 1min

From Zero to 150 Robots in Just 20 Months | Mike LeBlanc, Foundation Future Industries

From Zero to 150 Robots in Just 20 Months | Mike LeBlanc, Foundation Future Industries

Most humanoid robot companies are still running curated demos in replica environments. Foundation Future Industries is running 150 robots on real automotive production lines in Georgia, and heading to...

19 Aug 1h 6min

Why People Are Paying 10x More for AI - and What That Means for the Chip Market | Sid Sheth, d-Matrix

Why People Are Paying 10x More for AI - and What That Means for the Chip Market | Sid Sheth, d-Matrix

The AI chip market looks monolithic from the outside - NVIDIA dominates, and everyone else is fighting for scraps. But d-Matrix's CEO Sid Sheth argues that the market is quietly splitting into two dis...

17 Aug 50min

American Companies Have 36 Months to Go AI-Native or Get Left Behind | Drew Cukor, TWG AI

American Companies Have 36 Months to Go AI-Native or Get Left Behind | Drew Cukor, TWG AI

The same tools that slowed the U.S. military down in Afghanistan (PowerPoint, Excel, email, and Word) are now slowing American businesses down in the AI race. Drew Cukor spent 30 years as a Marine int...

13 Aug 58min

In 5 Years, 90% of What You Use AI For Will Run on Your Smartphone | Paolo Ardoino, Tether

In 5 Years, 90% of What You Use AI For Will Run on Your Smartphone | Paolo Ardoino, Tether

Hundreds of billions of dollars are flowing into AI data centers right now, and Paolo Ardoino, CEO of Tether - the company behind the world's most widely used stablecoin with 573 million users - think...

10 Aug 58min

AI Agents Fixing Your IT Before You Even Know Something Broke | Erhan Giral & Ryan Manning, BMC Helix

AI Agents Fixing Your IT Before You Even Know Something Broke | Erhan Giral & Ryan Manning, BMC Helix

Most enterprise IT teams spend the majority of their time fighting the same fires repeatedly. BMC Helix is building the AI system that handles those fires automatically, detecting anomalies, tracing r...

3 Aug 59min

Real AI Transformation Costs HALF of Everyone's Salary for 2 Years | Chris Blackburn, Liatrio

Real AI Transformation Costs HALF of Everyone's Salary for 2 Years | Chris Blackburn, Liatrio

Most companies think they're transforming with AI. They're not, and the gap between what they believe and what's actually happening on the ground is costing them far more than they realize. In this e...

30 Juli 1h 5min

"According to NASA's Definition of Life, I'm Not Alive" - Why Nobody Can Define Life | Dr. Kate Adamala

"According to NASA's Definition of Life, I'm Not Alive" - Why Nobody Can Define Life | Dr. Kate Adamala

Nobody has ever built a cell from scratch - assembled entirely from purified molecules on a shelf - that can feed itself, grow, and split into daughter cells through its own genetic activity. Until no...

29 Juli 46min

Populärt inom Teknik

uppgang-och-fall
market-makers
rss-elektrikerpodden
rss-laddstationen-med-elbilen-i-sverige
 och-bilen-gar-bra
skogsforum-podcast
natets-morka-sida
bli-saker-podden
rss-technokratin
rss-uppgang-och-fall
bilar-med-sladd
rss-veckans-ai
rss-fabriken-2
klocksnack-tillsammans-med-nymans-ur-1851
hej-bruksbil
rss-en-ai-till-kaffet
elbilsveckan
bosse-bildoktorn-och-hasse-p
ai-sweden-podcast
developers-mer-an-bara-kod