Azure API Management's GenAI Gateway with Andrei Kamenev
.NET Rocks!7 Aug 2024

Azure API Management's GenAI Gateway with Andrei Kamenev

How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Episoder(1958)

Peter DeBetta and Adam Machanic on creating good SQL databases

Peter DeBetta and Adam Machanic on creating good SQL databases

Peter and Adam talk about creating good SQL Server databases. We figured it was about time we did a good old fashioned data show!Support this podcast at — https://redcircle.com/net-rocks/donations

19 Mai 20091h

Doug Turnure and Johanna White are Ramping Up!

Doug Turnure and Johanna White are Ramping Up!

Doug Turnure and Johanna White talk about the Ramp Up, an online program that assists users in learning Microsoft technology.Support this podcast at — https://redcircle.com/net-rocks/donations

14 Mai 200949min

Kenn Scribner on REST

Kenn Scribner on REST

Carl and Richard talk to Kenn Scribner about REST, its origins and intended uses.Support this podcast at — https://redcircle.com/net-rocks/donations

12 Mai 200958min

Ted Neward on Oracle buying Sun

Ted Neward on Oracle buying Sun

Carl and Richard talk to Ted Neward about Sun being bought by Oracle, and other musings in the Java space.Support this podcast at — https://redcircle.com/net-rocks/donations

7 Mai 200957min

Kate Gregory Still Programs in C++!

Kate Gregory Still Programs in C++!

Attack of the Canadians!! In this show Kate gets hardcore, talking about C++, VC10, the Vista Bridge, and a few other technical gems.Support this podcast at — https://redcircle.com/net-rocks/donations

5 Mai 20091h 8min

Dino Esposito Gets Architectural!

Dino Esposito Gets Architectural!

Dino Esposito is back to share his latest thoughts about architecture.Support this podcast at — https://redcircle.com/net-rocks/donations

30 Apr 200952min

Shawn Wildermuth on Silverlight 3.0

Shawn Wildermuth on Silverlight 3.0

Shawn Wildermuth talks about the new features in Silverlight 3.0. Shawn brings a wealth of knowledge and experience to the table. Lots of great tips!Support this podcast at — https://redcircle.com/net-rocks/donations

28 Apr 20091h

Jeff Atwood talks Stack Overflow

Jeff Atwood talks Stack Overflow

Carl and Richard talk with Jeff Atwood about Stack Overflow and effective problem solving solutions.Support this podcast at — https://redcircle.com/net-rocks/donations

23 Apr 200957min

Populært innen Teknologi

romkapsel
rss-avskiltet
smart-forklart
teknisk-sett
shifter
rss-impressions-2
energi-og-klima
tomprat-med-gunnar-tjomlid
pedagogisk-intelligens
kunstig-intelligens-med-morten-goodwin
rss-polypod
fornybaren
rss-ki-til-kaffen
nasjonal-sikkerhetsmyndighet-nsm
i-loopen
rss-elektrolytten-en-podkast-fra-efo
fotopodden
kryptopraten
rss-rimelig-mistenkelig
rss-snakk-om-sikkerhet