How OpenAI Builds for 800 Million Weekly Users: Model Specialization and Fine-Tuning

How OpenAI Builds for 800 Million Weekly Users: Model Specialization and Fine-Tuning

In this episode, a16z GP Martin Casado sits down with Sherwin Wu, Head of Engineering for the OpenAI Platform, to break down how OpenAI organizes its platform across models, pricing, and infrastructure, and how it is shifting from a single general-purpose model to a portfolio of specialized systems, custom fine-tuning options, and node-based agent workflows.

They get into why developers tend to stick with a trusted model family, what builds that trust, and why the industry moved past the idea of one model that can do everything. Sherwin also explains the evolution from prompt engineering to context design and how companies use OpenAI’s fine-tuning and RFT APIs to shape model behavior with their own data.

Highlights from the conversation include:

• How OpenAI balances a horizontal API platform with vertical products like ChatGPT
• The evolution from Codex to the Composer model
• Why usage-based pricing works and where outcome-based pricing breaks
• What the Harmonic Labs and Rockset acquisitions added to OpenAI’s agent work
• Why the new agent builder is deterministic, node based, and not free roaming

Resources:

Follow Sherwin on X: https://x.com/sherwinwu

Follow Martin on X: https://x.com/martin_casado

Stay Updated:

If you enjoyed this episode, be sure to like, subscribe, and share with your friends!

Find a16z on X: https://x.com/a16z

Find a16z on LinkedIn: https://www.linkedin.com/company/a16z

Listen to the a16z Podcast on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX

Listen to the a16z Podcast on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711

Follow our host: https://x.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see http://a16z.com/disclosures

Stay Updated:

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Podcast on Spotify

Listen to the a16z Podcast on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Episoder(973)

a16z Podcast: The Rise of Full Stack Startups

a16z Podcast: The Rise of Full Stack Startups

Suppose you develop a new technology that is valuable to some industry. The old approach was to sell or license your technology to the existing companies in that industry. The new approach is to build a complete, end-to-end product or service that bypasses existing companies. Andreessen Horowitz’s Chris Dixon, Balaji Srinivasan and Benedict Evans discuss the reasons behind, and advantages of, going “full stack.” Stay Updated:Find a16z on XFind a16z on LinkedInListen to the a16z Podcast on SpotifyListen to the a16z Podcast on Apple PodcastsFollow our host: https://twitter.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

27 Mar 201418min

a16z Podcast: Searching for Mobile’s Own PageRank

a16z Podcast: Searching for Mobile’s Own PageRank

The mobile experience is still in its 1995 Yahoo phase, a sea of apps and websites without an easy way to find what you want and need on your smartphone. What will be mobile’s version of PageRank, the algorithm that made the web manageable? What is the interaction model and the form - app, card, URL – that will help us find, explore and engage with people, products and services from our mobile devices? Andreessen Horowitz’s Chris Dixon, Benedict Evans and Balaji Srinivasan delve into the options. Stay Updated:Find a16z on XFind a16z on LinkedInListen to the a16z Podcast on SpotifyListen to the a16z Podcast on Apple PodcastsFollow our host: https://twitter.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

24 Mar 201412min

a16z Podcast: Where is the Technology That "Matters?" Right Here

a16z Podcast: Where is the Technology That "Matters?" Right Here

There is a recurring theme that the tech industry is busy cranking out fluffy social apps rather than hardcore technology. Not the case, say Chris Dixon, Benedict Evans and Balaji Srinivasan. Not only are tech entrepreneurs going after the deficiencies in healthcare, transportation, finance, energy - you name it - with new approaches riding on top of sophisticated technologies, what looks like fluff today often wields some serious influence tomorrow. Stay Updated:Find a16z on XFind a16z on LinkedInListen to the a16z Podcast on SpotifyListen to the a16z Podcast on Apple PodcastsFollow our host: https://twitter.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

21 Mar 201414min

a16z Podcast: The State of the Bitcoin Ecosystem, and a Theory on Satoshi

a16z Podcast: The State of the Bitcoin Ecosystem, and a Theory on Satoshi

Andreessen Horowitz's Chris Dixon and Balaji Srinivasan discuss the state of the Bitcoin ecosystem now that the Mt. Gox dust has settled. What's next in crypto-currency, and a theory on Bitcoin creator Satoshi (not Dorian) Nakamoto. Stay Updated:Find a16z on XFind a16z on LinkedInListen to the a16z Podcast on SpotifyListen to the a16z Podcast on Apple PodcastsFollow our host: https://twitter.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

20 Mar 201415min

a16z Podcast: Apple and Google Won the Mobile OS War, But a New War Has Already Begun

a16z Podcast: Apple and Google Won the Mobile OS War, But a New War Has Already Begun

Apple and Google won the mobile OS war, but the next war – to build big businesses on top of Android and iOS – is just beginning. Andreessen Horowitz Partner Benedict Evans untangles what the next phase of mobile means for entrepreneurs, Apple and Google's competitors, and consumers eager for the next great gadget. Stay Updated:Find a16z on XFind a16z on LinkedInListen to the a16z Podcast on SpotifyListen to the a16z Podcast on Apple PodcastsFollow our host: https://twitter.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

13 Mar 201427min

Populært innen Business og økonomi

stopp-verden
dine-penger-pengeradet
e24-podden
rss-penger-polser-og-politikk
kommentarer-fra-aftenposten
rss-borsmorgen-okonominyhetene
lydartikler-fra-aftenposten
finansredaksjonen
rss-vass-knepp-show
livet-pa-veien-med-jan-erik-larssen
tid-er-penger-en-podcast-med-peter-warren
pengepodden-2
okonomiamatorene
morgenkaffen-med-finansavisen
utbytte
stormkast-med-valebrokk-stordalen
rss-sunn-okonomi
rss-rettssikkerhet-bak-fasaden-pa-rettsstaten-norge-en-podcast-av-sonia-loinsworth-og-foreningen-rettssikkerhet-for-alle
lederpodden
arcticpodden