Text to Video: The Next Leap in AI Generation
The a16z Show20 Joulu 2023

Text to Video: The Next Leap in AI Generation

General Partner Anjney Midha explores the cutting-edge world of text-to-video AI with AI researchers Andreas Blattmann and Robin Rombach.

Released in November, Stable Video Diffusion is their latest open-source generative video model, overcoming challenges in size and dynamic representation.

In this episode Robin and Andreas share why translating text to video is complex, the key role of datasets, current applications, and the future of video editing.

Topics Covered:

00:00 - Text to Video: The Next Leap in AI Generation

02:41 - The Stable Diffusion backstory

04:25 - Diffusion vs autoregressive models

06:09 - The benefits of single step sampling

09:15 - Why generative video?

11:19 - Understanding physics through AI video

12:20 - The challenge of creating generative video

15:36 - Data set selection and training

17:50 - Structural consistency and 3D objects

19:50 - Incorporating LoRAs

21:24 - How should creators think about these tools?

23:46 - Open challenges in video generation

25:42 - Infrastructure challenges and future research

Resources:

Find Robin on Twitter: https://twitter.com/robrombach

Find Andreas on Twitter: https://twitter.com/andi_blatt

Find Anjney on Twitter: https://twitter.com/anjneymidha

Stay Updated:

Find a16z on Twitter: https://twitter.com/a16z

Find a16z on LinkedIn: https://www.linkedin.com/company/a16z

Subscribe on your favorite podcast app: https://a16z.simplecast.com/

Follow our host: https://twitter.com/stephsmithio

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(1000)

Databricks CEO on AI Pacing, Cyber Risk, and the Enterprise

Databricks CEO on AI Pacing, Cyber Risk, and the Enterprise

Databricks co-founder and CEO Ali Ghodsi joins a16z General Partners Martin Casado and Sarah Wang for a conversation about AI risk, recursive self-improvement, cybersecurity, and what’s actually holdi...

18 Syys 1h 8min

The Next Frontier of AI Video Is Control

The Next Frontier of AI Video Is Control

a16z General Partner Jennifer Li sits down with fal co-founder Gorkem Yurtseven and Head of Engineering Batuhan Taskaya to discuss what changes when generative video becomes fast enough to run in real...

17 Syys 39min

The AI-Native CRM

The AI-Native CRM

a16z’s Alex Rampell and Joe Schmidt sit down with Lightfield co-founder and CEO Keith Peiris to discuss what it takes to rethink the CRM for an AI-native world, and the unusual pivot that got him ther...

16 Syys 52min

The Age of Body Futurism | Ruby Justice Thelot

The Age of Body Futurism | Ruby Justice Thelot

Elena Burger sits down with academic and cyber ethnographer Ruby Justice Thelot to explore the increasingly blurry line between internet culture and the real world, and how to tell the difference betw...

15 Syys 42min

Greg Brockman on Why OpenAI Says We’re Entering the AGI Era

Greg Brockman on Why OpenAI Says We’re Entering the AGI Era

Ben Horowitz and Erik Torenberg sit down with OpenAI co-founder and President Greg Brockman to discuss why he believes AI has entered a new phase, what OpenAI’s latest models reveal about the path to ...

14 Syys 51min

World Models, Robotics, and the Future of 3D AI

World Models, Robotics, and the Future of 3D AI

World Labs co-founder Justin Johnson joins MTS hosts Theo Jaffee and Sofia Puccini to discuss Atlas, World Labs’ latest world model, and the broader case for AI systems that understand and interact wi...

13 Syys 23min

Why Companies Are Becoming a Series of Loops | Anish Acharya on Lenny’s Podcast

Why Companies Are Becoming a Series of Loops | Anish Acharya on Lenny’s Podcast

a16z General Partner Anish Acharya joins Lenny Rachitsky on Lenny’s Podcast to discuss why fears of an AI-driven “permanent underclass” may be misplaced, how AI is changing the way companies operate, ...

12 Syys 1h 18min

What It Takes to Build a Startup | Andrew Chen & Matt Perault

What It Takes to Build a Startup | Andrew Chen & Matt Perault

a16z’s Matt Perault sits down with General Partner and Speedrun lead Andrew Chen on the a16z AI Policy Brief to explore what “Little Tech” actually looks like at the earliest stages, and why the reali...

11 Syys 38min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
vallattomat
psykopodiaa-podcast
rss-rahapodi
mimmit-sijoittaa
rss-oivalluksia-rahasta-elamasta
ostan-asuntoja-podcast
lakicast
oppimisen-psykologia
rss-inderes
rss-paasipodi
juristipodi
hyva-paha-johtaminen
rss-karon-grilli
rss-rahamania
rss-pinnan-alle
rss-alanvaihtajat
rss-startup-ministerio
rahapuhetta
rss-siksi-viestinta