Azure API Management's GenAI Gateway with Andrei Kamenev
.NET Rocks!7 Aug 2024

Azure API Management's GenAI Gateway with Andrei Kamenev

How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Episoder(1958)

Brian Noyes on Workflow 4.0

Brian Noyes on Workflow 4.0

Brian Noyes talks about Workflow Foundation 4.0Support this podcast at — https://redcircle.com/net-rocks/donations

14 Jul 20091h 4min

Paul Stubbs on Silverlight in Sharepoint

Paul Stubbs on Silverlight in Sharepoint

Pual Stubbs from Microsoft talks about the marriage of Silverlight and Sharepoint.Support this podcast at — https://redcircle.com/net-rocks/donations

9 Jul 200952min

Stephen Forte on Data Access Options

Stephen Forte on Data Access Options

Forte is back talking about all the options .NET developers have for data access, and gives some guidelines as to when to use what.Support this podcast at — https://redcircle.com/net-rocks/donations

7 Jul 200953min

Scott Ambler on the Agile Process Maturity Model

Scott Ambler on the Agile Process Maturity Model

Scott Ambler from IBM talks about the Agile Process Maturity Model, which defines three levels of Agile methodology.Support this podcast at — https://redcircle.com/net-rocks/donations

2 Jul 20091h 5min

Michael Stiefel on Cloud Computing

Michael Stiefel on Cloud Computing

Michael Stiefel is back to talk about the realities of Cloud Computing including offerings from Amazon, Google, and Microsoft Azure.Support this podcast at — https://redcircle.com/net-rocks/donations

30 Jun 200958min

Scott Hanselman and Phil Haack at NDC!

Scott Hanselman and Phil Haack at NDC!

Carl and Richard talked to Scott Hanselman and Phil Haack live on stage at the Norweigian Developer's Conference last week about new and cool toys and technology.Support this podcast at — https://redcircle.com/net-rocks/donations

25 Jun 200955min

Sahil Malik's Sharepoint Checklist

Sahil Malik's Sharepoint Checklist

Sahil Malik tells us what every developer should know about Sharepoint.Support this podcast at — https://redcircle.com/net-rocks/donations

23 Jun 20091h 6min

Jason Diller and Daniel Crenna on TweetSharp

Jason Diller and Daniel Crenna on TweetSharp

TweetSharp is a .NET library for developing Twitter applications. Yeah, that's what I thought too until we talked to these guys! You'll want it.Support this podcast at — https://redcircle.com/net-rocks/donations

18 Jun 200957min

Populært innen Teknologi

romkapsel
rss-avskiltet
smart-forklart
teknisk-sett
shifter
rss-impressions-2
tomprat-med-gunnar-tjomlid
energi-og-klima
kunstig-intelligens-med-morten-goodwin
pedagogisk-intelligens
rss-polypod
fornybaren
teknologi-og-mennesker
rss-ki-til-kaffen
kryptopraten
nasjonal-sikkerhetsmyndighet-nsm
i-loopen
rss-personvernpodden
fotopodden
rss-elektrolytten-en-podkast-fra-efo