Why is adding LLM into an App so hard?
cloud20307 Mar 2025

Why is adding LLM into an App so hard?

We talk about current events, the acquisition of data stacks and the closing of the HashiCorp acquisition by IBM. Later, we dive into the productivity of AI and what's going on - are companies really getting the benefits that they expect from AI chat bot integrations and what the challenges are? We touch base on a little bit of something more infrastructure focused, where I give a preview of work I've been doing on separating Kubernetes virtualization from Kubernetes development use cases, which is something that we will be talking about more in the future. References: https://www.windowscentral.com/software-apps/microsoft-just-put-this-controversial-notepad-feature-behind-a-paywall https://www.ibm.com/new/announcements/ibm-to-acquire-datastax-helping-clients-bring-the-power-of-unstructured-data-to-enterprise-ai-applications https://www.youtube.com/watch?v=Ioc3r70HNLM https://www.linkedin.com/posts/dhinchcliffe_major-agentic-ai-news-for-cios-this-week-activity-7303122989498138624-jR2R/ 20250227

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(500)

Harness AI Governance

Harness AI Governance

In this episode, we continue our discussion of governed execution for agentic AI and how to prevent agents from taking actions they should not take. We use a maintenance example to examine access, app...

25 Sep 48min

Harnesses Pt 1

Harnesses Pt 1

This week we discuss the role of a harness in AI systems and why it matters for infrastructure, tool use, rules, and operational constraints when an AI acts on behalf of a person or organization. We a...

18 Sep 37min

Whats Up with VMware?

Whats Up with VMware?

In this episode, we are joined by guest Byron Dill from Summit for a great deep dive into virtualization. We talk about virtualization from an enterprise and infrastructure perspective, with a focus o...

11 Sep 58min

Token Cost Optimization

Token Cost Optimization

In this episode, we focus on token cost and token optimization in generative AI, and we discuss why token use needs budgets and controls rather than being treated as unlimited. We also talk about how ...

4 Sep 39min

Vibing vs Buying

Vibing vs Buying

In this episode, we get into current market news, including pending IPOs, hardware investment, and IBM’s AI-related announcement with Red Hat, and what this may mean for open weights models and hybrid...

28 Aug 55min

AI Harnesses and Hosting

AI Harnesses and Hosting

This week we have an exciting conversation about harnesses, neoclouds, open weights models, and the current AI infrastructure landscape. We discuss bare metal automation, agent-friendly APIs, CPU comp...

14 Aug 57min

Innovations in Agentic Pipelines

Innovations in Agentic Pipelines

In this episode, we discuss Red Hat’s enterprise AI work, including OpenShift AI, safety guardrails, and router-based model selection. We also talk about smaller AI systems, long-term memory, and the ...

14 Aug 52min

Mirantis IREN Acquisition

Mirantis IREN Acquisition

We discuss the acquisition of Mirantis by the neocloud company IREN, and use it to examine the current market for infrastructure and AI deployment. We look at Mirantis’ consulting business, Kubernetes...

7 Aug 1h 4min

Populært innen Teknologi

teknisk-sett
tomprat-med-gunnar-tjomlid
lydartikler-fra-aftenposten
energi-og-klima
elektropodden
rss-ki-praten
hans-petter-og-co
nasjonal-sikkerhetsmyndighet-nsm
shifter
smart-forklart
rss-alt-som-gar-pa-strom
rss-ai-forklart
teknologi-og-mennesker
rss-snakk-om-sikkerhet
rss-kunstig-intelligens-med-elisabeth-maren-og-morten
fornybaren
rss-teknologioptimistene-en-podkast-om-teknologi-og-mennesker
pedagogisk-intelligens
rss-alt-vi-kan
rss-heis