Azure API Management's GenAI Gateway with Andrei Kamenev
.NET Rocks!7 Aug 2024

Azure API Management's GenAI Gateway with Andrei Kamenev

How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(2005)

The Role of AI in Testing with Debbie O'Brien

The Role of AI in Testing with Debbie O'Brien

How has testing changed in the era of AI? Carl and Richard talk to Debbie O'Brien in her new role at Zephyr about using LLMs to help build and validate tests - and much more. Debbie talks about joinin...

16 Juli 53min

Open Source Maintenance Fee Update with Rob Mensching

Open Source Maintenance Fee Update with Rob Mensching

The Open Source Maintenance Fee is more than a year old now - how are things going? Carl and Richard catch up with Rob Mensching to discuss the OSMF and its success in supporting Rob's WiX Toolset pro...

8 Juli 58min

Azure Container Apps with Paul Yuknewicz and Jan Kalis

Azure Container Apps with Paul Yuknewicz and Jan Kalis

Have you checked out Azure Container Apps lately? Carl and Richard talk to Paul Yuknewicz and Jan Kalis about how they have sped up startup time with Container Apps using a feature called Express, and...

2 Juli 58min

DNSimple CLI with Anthony Eden

DNSimple CLI with Anthony Eden

DNSimple has a CLI! Carl and Richard talk to DNSimple CEO Anthony Eden about the evolution of the DNSimple CLI in today's software market. DNSimple provides DNS, domain registrar, and certificate serv...

24 Juni 58min

Data Centers in Space Geek Out

Data Centers in Space Geek Out

Do data centers in space make any sense? Time for a rare summer-time Geek Out! Richard chats with Carl about all the hype surrounding building orbital data centers for AI workloads. Richard points out...

17 Juni 1h 17min

Event Sourcing using Cratis with Einar Ingebrigsten

Event Sourcing using Cratis with Einar Ingebrigsten

Can tooling make event sourcing implementations easier? Carl and Richard talk to Einar Ingebrigsten about his work on cratis.io - a set of open-source tools for implementing event sourcing in your app...

11 Juni 54min

Daemonic AI with Emmz Rendle

Daemonic AI with Emmz Rendle

Is it time to build your own agent harness? Carl and Richard talk to Emmz Rendle about her work on Daemonic AI, which gives you more control over which models and tooling you use to build software wit...

4 Juni 58min

Ten Things Scott Sauber Does On Every .NET App

Ten Things Scott Sauber Does On Every .NET App

What settings, configurations, and workflows do you use for every .NET app? Carl and Richard talk to Scott Sauber about his list - from organizing folders by feature, to logging, security, and testing...

28 Maj 55min

Populärt inom Teknik

uppgang-och-fall
elbilsveckan
market-makers
natets-morka-sida
rss-elektrikerpodden
rss-technokratin
developers-mer-an-bara-kod
skogsforum-podcast
bli-saker-podden
rss-heja-framtiden
rss-veckans-ai
har-vi-akt-till-mars-an
rss-uppgang-och-fall
rss-en-ai-till-kaffet
rss-snacka-om-ai
allt-du-behover-veta-om-ny-teknik
solcellskollens-podcast
rss-kack-tech-podcast
rss-inet-patch-notes
rss-hit-med-dina-lunchpengar