Inferact: Building the Infrastructure That Runs Modern AI

Inferact: Building the Infrastructure That Runs Modern AI

Inferact is a new AI infrastructure company founded by the creators and core maintainers of vLLM. Its mission is to build a universal, open-source inference layer that makes large AI models faster, cheaper, and more reliable to run across any hardware, model architecture, or deployment environment. Together, they broke down how modern AI models are actually run in production, why “inference” has quietly become one of the hardest problems in AI infrastructure, and how the open-source project vLLM emerged to solve it. The conversation also looked at why the vLLM team started Inferact and their vision for a universal inference layer that can run any model, on any chip, efficiently.

Follow Matt Bornstein on X: https://twitter.com/BornsteinMatt

Follow Simon Mo on X: https://twitter.com/simon_mo_

Follow Woosuk Kwon on X: https://twitter.com/woosuk_k

Follow vLLM on X: https://twitter.com/vllm_project

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Episoder(1000)

a16z Podcast: The Data Science of Food and Taste

a16z Podcast: The Data Science of Food and Taste

The best cooks know cooking a meal is all about having a plan (and a back-up plan if things go south); get the cooking out of the way, and then you can enjoy your family and friends -- the most import...

25 Nov 201519min

a16z Podcast: Data Down on the Farm

a16z Podcast: Data Down on the Farm

Farmers are among the best hackers in the business. They can fix anything, and are endlessly tweaking their approach to a business that is up against the strongest force on the planet: nature. As adop...

24 Nov 201530min

a16z Podcast: The Future of Food

a16z Podcast: The Future of Food

Rob Rhinehart, like most startup entrepreneurs, was strapped for cash and time as developed his ideas and ultimately a company. What stood out to Rhinehart in that all-consuming and ongoing process wa...

24 Nov 201532min

a16z Podcast: On Recent IPOs and Comparing Private vs. Public Valuations

a16z Podcast: On Recent IPOs and Comparing Private vs. Public Valuations

It's hip to be Square right now. Or is it? How do we assess whether it -- and other recent IPOs -- went well, not just for investors but overall? In this episode of the a16z Podcast, Nicole Irvin and ...

21 Nov 201544min

a16z Podcast: London Calling for Tech Done in a Different Way

a16z Podcast: London Calling for Tech Done in a Different Way

If the U.K. is to continue its economic march onward and upward, technology needs to play an increasing role, say Martha Lane Fox (that's Baroness of Soho Lane-Fox in more public settings) and Russell...

20 Nov 201541min

a16z Podcast: Defeating Aging with Aubrey de Grey

a16z Podcast: Defeating Aging with Aubrey de Grey

There are those who would say that Aubrey de Grey is out to cure death, but what this former artificial intelligence specialist turned gerontologist is really focused on is health -- and the side effe...

19 Nov 201527min

a16z Podcast: Fintech from the World's Financial Capital -- London

a16z Podcast: Fintech from the World's Financial Capital -- London

The title of world's financial capital bounces back and forth between London and New York. This year London has bragging rights, but does being the word's center of gravity for finance mean so-called ...

17 Nov 201541min

a16z Podcast: Artificial Intelligence and the 'Space of Possible Minds'

a16z Podcast: Artificial Intelligence and the 'Space of Possible Minds'

What is A.I. or artificial intelligence but the 'space of possible minds', argues Murray Shanahan, scientific advisor on the movie Ex Machina and Professor of Cognitive Robotics at Imperial College Lo...

15 Nov 201541min

Populært innen Business og økonomi

stopp-verden
lydartikler-fra-aftenposten
dine-penger-pengeradet
e24-podden
rss-penger-polser-og-politikk
rss-borsmorgen-okonominyhetene
rss-pa-konto
pengesnakk
pengepodden-2
finansredaksjonen
morgenkaffen-med-finansavisen
liberal-halvtime
rss-skravla-gar
utbytte
tid-er-penger-en-podcast-med-peter-warren
stormkast-med-valebrokk-stordalen
livet-pa-veien-med-jan-erik-larssen
rss-markedspuls-2
rss-sunn-okonomi
lederpodden