Azure API Management's GenAI Gateway with Andrei Kamenev
.NET Rocks!7 Aug 2024

Azure API Management's GenAI Gateway with Andrei Kamenev

How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(2004)

Open Source Maintenance Fee Update with Rob Mensching

Open Source Maintenance Fee Update with Rob Mensching

The Open Source Maintenance Fee is more than a year old now - how are things going? Carl and Richard catch up with Rob Mensching to discuss the OSMF and its success in supporting Rob's WiX Toolset pro...

8 Juli 58min

Azure Container Apps with Paul Yuknewicz and Jan Kalis

Azure Container Apps with Paul Yuknewicz and Jan Kalis

Have you checked out Azure Container Apps lately? Carl and Richard talk to Paul Yuknewicz and Jan Kalis about how they have sped up startup time with Container Apps using a feature called Express, and...

2 Juli 58min

DNSimple CLI with Anthony Eden

DNSimple CLI with Anthony Eden

DNSimple has a CLI! Carl and Richard talk to DNSimple CEO Anthony Eden about the evolution of the DNSimple CLI in today's software market. DNSimple provides DNS, domain registrar, and certificate serv...

24 Juni 58min

Data Centers in Space Geek Out

Data Centers in Space Geek Out

Do data centers in space make any sense? Time for a rare summer-time Geek Out! Richard chats with Carl about all the hype surrounding building orbital data centers for AI workloads. Richard points out...

17 Juni 1h 17min

Event Sourcing using Cratis with Einar Ingebrigsten

Event Sourcing using Cratis with Einar Ingebrigsten

Can tooling make event sourcing implementations easier? Carl and Richard talk to Einar Ingebrigsten about his work on cratis.io - a set of open-source tools for implementing event sourcing in your app...

11 Juni 54min

Daemonic AI with Emmz Rendle

Daemonic AI with Emmz Rendle

Is it time to build your own agent harness? Carl and Richard talk to Emmz Rendle about her work on Daemonic AI, which gives you more control over which models and tooling you use to build software wit...

4 Juni 58min

Ten Things Scott Sauber Does On Every .NET App

Ten Things Scott Sauber Does On Every .NET App

What settings, configurations, and workflows do you use for every .NET app? Carl and Richard talk to Scott Sauber about his list - from organizing folders by feature, to logging, security, and testing...

28 Maj 55min

Using AI to Measure Quality of AI with Vishwas Lele

Using AI to Measure Quality of AI with Vishwas Lele

Large Language Models can generate a lot of text - but is it any good? Carl and Richard talk to Vishwas Lele about his ongoing efforts at pWin.ai to build tools for responding to government RFPs. Vish...

21 Maj 58min

Populärt inom Teknik

uppgang-och-fall
elbilsveckan
market-makers
rss-elektrikerpodden
natets-morka-sida
bilar-med-sladd
developers-mer-an-bara-kod
rss-veckans-ai
skogsforum-podcast
rss-it-sakerhetspodden
rss-laddstationen-med-elbilen-i-sverige
rss-technokratin
bli-saker-podden
rss-uppgang-och-fall
har-vi-akt-till-mars-an
rss-en-ai-till-kaffet
algoritmen
ai-sweden-podcast
rss-sakerhetspodcasten
rss-inet-patch-notes