Inferact: Building the Infrastructure That Runs Modern AI

Inferact: Building the Infrastructure That Runs Modern AI

Inferact is a new AI infrastructure company founded by the creators and core maintainers of vLLM. Its mission is to build a universal, open-source inference layer that makes large AI models faster, cheaper, and more reliable to run across any hardware, model architecture, or deployment environment. Together, they broke down how modern AI models are actually run in production, why “inference” has quietly become one of the hardest problems in AI infrastructure, and how the open-source project vLLM emerged to solve it. The conversation also looked at why the vLLM team started Inferact and their vision for a universal inference layer that can run any model, on any chip, efficiently.

Follow Matt Bornstein on X: https://twitter.com/BornsteinMatt

Follow Simon Mo on X: https://twitter.com/simon_mo_

Follow Woosuk Kwon on X: https://twitter.com/woosuk_k

Follow vLLM on X: https://twitter.com/vllm_project

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Avsnitt(1000)

a16z Podcast: Getting That First Board Seat

a16z Podcast: Getting That First Board Seat

When you're going for a board interview -- especially when it's your first board seat -- you're actually not supposed to go into it advocating for yourself and trying to convince people that you're a ...

13 Aug 201520min

a16z Podcast: Is It Possible to Achieve Equitable Equity for Startup Employees?

a16z Podcast: Is It Possible to Achieve Equitable Equity for Startup Employees?

There's been a lot of activity lately around trying to improve equity compensation (for example, by removing tax liabilities that handcuff them). Or by making equity more equitable in other ways; as f...

7 Aug 201523min

a16z Podcast: Compensation Isn’t About Paying the Most, It’s About Being Consistent

a16z Podcast: Compensation Isn’t About Paying the Most, It’s About Being Consistent

The key to any great company is the people. Of course, part of attracting and keeping the best people is compensation. It seems straightforward, but if you don’t develop a philosophy early around how ...

7 Aug 201531min

a16z Podcast: Bitcoin, Greece, and What’s Next for Cryptocurrency

a16z Podcast: Bitcoin, Greece, and What’s Next for Cryptocurrency

There are few things as old as financial catastrophe, except maybe finance. But in the latest fiscal meltdown in Greece, people started asking questions about whether newer technology -- bitcoin and t...

7 Aug 201534min

a16z Podcast: A Copernican Update ... In Tech, the Smartphone is the Center

a16z Podcast: A Copernican Update ... In Tech, the Smartphone is the Center

Given the endless time we all spend with our noses in our phones, it may not be too surprising to hear that the smartphone has taken over the tech world. But the smartphone’s dominance is so complete,...

5 Aug 201522min

a16z Podcast: How Innovation Ecosystems Grow Around the Globe

a16z Podcast: How Innovation Ecosystems Grow Around the Globe

Why do so many-government led efforts to build the next "Silicon Valley" in one geography or another fail? Is it misguided to even try? But then what does make such innovation clusters work? In this s...

1 Aug 201534min

a16z Podcast: These Girls Code

a16z Podcast: These Girls Code

We sat down with four jet-lagged high school hackers from Nigeria, Brazil, and India -- representing some of the finalists in this year’s Technovation coding competition in San Francisco -- to hear ab...

30 Juli 20156min

a16z Podcast: Why Every Business is in the Data Business

a16z Podcast: Why Every Business is in the Data Business

It’s not just the likes of Google, Facebook, and Amazon that lean on a massive and growing corpus of data, today every company is a data-driven company. In this world, access to data -- and how you ma...

28 Juli 201522min

Populärt inom Business & ekonomi

framgangspodden
varvet
rss-jossan-nina
rss-svart-marknad
rss-borsens-finest
svd-tech-brief
avanzapodden
uppgang-och-fall
badfluence
bathina-en-podcast
fill-or-kill
lastbilspodden
rss-inga-dumma-fragor-om-pengar
rss-dagen-med-di
dynastin
tabberaset
24fragor
rikatillsammans-om-privatekonomi-rikedom-i-livet
borsmorgon
kapitalet-en-podd-om-ekonomi