Azure API Management's GenAI Gateway with Andrei Kamenev
.NET Rocks!7 Aug 2024

Azure API Management's GenAI Gateway with Andrei Kamenev

How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Episoder(1958)

Aslam Khan talks Design

Aslam Khan talks Design

Aslam Khan tells us his thoughts on good software design, focusing on the domain, resisting prototypes and big design up front. He also shares his thoughts about Software as a Service.Support this podcast at — https://redcircle.com/net-rocks/donations

27 Jan 200958min

Interviews from Codemash 2009

Interviews from Codemash 2009

Carl and Richard interview Joe Fiorini, Jonathan Penn, Josh Walsh, and Andrew Kavanaugh about winning the 2008 Rails Rumble contest; then Chris Marinos and Mike Woelmer about their Paint Wars XNA game; and finally Corey Haines about his Pair Programming Tour.Support this podcast at — https://redcircle.com/net-rocks/donations

22 Jan 20091h 12min

Mark Dunn Interviews at TechEd Europe 2008

Mark Dunn Interviews at TechEd Europe 2008

Mark Dunn joins Carl and Richard to review some of the interviews he did at TechEd EMEA in Barcelona, Spain in November, 2008. On board are Bob Beauchemin, John Flanders, Pat Helland, Richard Pawson, and Jay Roxe.Support this podcast at — https://redcircle.com/net-rocks/donations

20 Jan 200959min

Live from CodeMash 2009!

Live from CodeMash 2009!

Carl and Richard talk to an esteemed panel of experts about Rich Internet Applications, focusing on web-based apps at CodeMash 2009 in Sandusky, OH.Support this podcast at — https://redcircle.com/net-rocks/donations

15 Jan 20091h 5min

Ward Bell on ORMs.

Ward Bell on ORMs.

Ward Bell offers his opinion of Object Relational Mappers, the Entity Framework, LINQ to SQL, and Silverlight.Support this podcast at — https://redcircle.com/net-rocks/donations

13 Jan 200959min

Uncle Bob at Oredev

Uncle Bob at Oredev

Carl and Richard catch up with Bob Martin at Oredev in Malmo, Sweden. Topics range from debugging to software quality. Great show.Support this podcast at — https://redcircle.com/net-rocks/donations

8 Jan 200953min

Nick Hodges on Delphi.NET

Nick Hodges on Delphi.NET

Carl and Richard talk to Nick Hodges about Delphi.NET.Support this podcast at — https://redcircle.com/net-rocks/donations

6 Jan 200954min

James Whittaker Takes Testing Seriously

James Whittaker Takes Testing Seriously

James Whittaker brings a practical approach to testing, and his viewpoint may surprise you.Support this podcast at — https://redcircle.com/net-rocks/donations

1 Jan 200950min

Populært innen Teknologi

romkapsel
rss-avskiltet
smart-forklart
teknisk-sett
tomprat-med-gunnar-tjomlid
rss-impressions-2
shifter
energi-og-klima
kunstig-intelligens-med-morten-goodwin
pedagogisk-intelligens
rss-polypod
fornybaren
rss-ki-til-kaffen
nasjonal-sikkerhetsmyndighet-nsm
i-loopen
fotopodden
rss-elektrolytten-en-podkast-fra-efo
kryptopraten
rss-rimelig-mistenkelig
rss-snakk-om-sikkerhet