Inferact: Building the Infrastructure That Runs Modern AI

Inferact: Building the Infrastructure That Runs Modern AI

Inferact is a new AI infrastructure company founded by the creators and core maintainers of vLLM. Its mission is to build a universal, open-source inference layer that makes large AI models faster, cheaper, and more reliable to run across any hardware, model architecture, or deployment environment. Together, they broke down how modern AI models are actually run in production, why “inference” has quietly become one of the hardest problems in AI infrastructure, and how the open-source project vLLM emerged to solve it. The conversation also looked at why the vLLM team started Inferact and their vision for a universal inference layer that can run any model, on any chip, efficiently.

Follow Matt Bornstein on X: https://twitter.com/BornsteinMatt

Follow Simon Mo on X: https://twitter.com/simon_mo_

Follow Woosuk Kwon on X: https://twitter.com/woosuk_k

Follow vLLM on X: https://twitter.com/vllm_project

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Episoder(1000)

a16z Podcast: Beyond Lean Startups

a16z Podcast: Beyond Lean Startups

What began as a scientific approach to creating and managing startups has now become a worldwide movement for companies of all sizes -- and for creating (or rather rediscovering) entrepreneurs in all ...

7 Nov 201550min

a16z Podcast: A Whirlwind Tour of Policy Issues in Tech

a16z Podcast: A Whirlwind Tour of Policy Issues in Tech

There's a "game" being played right now among lawmakers and tech companies around policy issues, and as tech touches everything, everyone has to play some version of it. Even if the game keeps changin...

3 Nov 201551min

a16z Podcast: Telepresence and Tech for a Distributed Workforce

a16z Podcast: Telepresence and Tech for a Distributed Workforce

Telepresence. It's an ugly, outdated word for an attractive and current/ emerging phenomenon where people can work from anywhere, anytime. It's technology for the way we work today. But is it as easy ...

3 Nov 201538min

a16z Podcast: 'The Most Boring Yet Valuable' 20 Minutes, All About Board Minutes

a16z Podcast: 'The Most Boring Yet Valuable' 20 Minutes, All About Board Minutes

"The most boring yet valuable podcast in a16z history" -- he (our guest Joe Grundfest) said it, not we! That’s because in this episode of the a16z Podcast, Stanford law professor and former SEC commis...

3 Nov 201521min

a16z Podcast: Boards and the Power of Networks

a16z Podcast: Boards and the Power of Networks

It's easy to argue for "choosing possibility" when it comes to addressing diversity and inclusion in tech when certain people have access to networks and others don't. BoardList -- more of a talent ma...

29 Okt 201522min

a16z Podcast: Holy Non Sequiturs, Batman: What Disruption Theory Is ... and Isn't

a16z Podcast: Holy Non Sequiturs, Batman: What Disruption Theory Is ... and Isn't

Disruption is such an overused buzzword. But the word itself does have meaning: As defined by the Oxford and Merriam-Webster dictionaries, it is a "disturbance...that interrupts an event, activity, or...

24 Okt 201536min

a16z Podcast: What Comes After the Smartphone

a16z Podcast: What Comes After the Smartphone

Technology is a progression of new ideas and new platforms gobbling up the one that came before. In the world of computers we went from mainframes to mini computers to PCs. And then came the mobile ph...

22 Okt 201522min

a16z Podcast: Belief -- An Interview with Oprah Winfrey

a16z Podcast: Belief -- An Interview with Oprah Winfrey

This special episode of the a16z Podcast is based on a Q&A from an early screening we hosted of OWN (Oprah Winfrey Network)'s "Belief", which just premiered and airs over seven consecutive nights. Thi...

16 Okt 201528min

Populært innen Business og økonomi

stopp-verden
lydartikler-fra-aftenposten
dine-penger-pengeradet
e24-podden
rss-penger-polser-og-politikk
rss-borsmorgen-okonominyhetene
rss-pa-konto
pengesnakk
pengepodden-2
finansredaksjonen
morgenkaffen-med-finansavisen
liberal-halvtime
rss-skravla-gar
utbytte
tid-er-penger-en-podcast-med-peter-warren
stormkast-med-valebrokk-stordalen
livet-pa-veien-med-jan-erik-larssen
rss-markedspuls-2
rss-sunn-okonomi
lederpodden