Azure API Management's GenAI Gateway with Andrei Kamenev
.NET Rocks!7 Aug 2024

Azure API Management's GenAI Gateway with Andrei Kamenev

How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Episoder(1994)

Stephen Forte

Stephen Forte

Stephen talks about the International .NET Association (INETA - www.ineta.org), relates his .NET success stories, and talks about design patterns, COM Interop, Performance Anxiety, ASP.NET Forms Authe...

17 Mar 20031h 11min

Bill Vaughn (Again)

Bill Vaughn (Again)

Bill talks with us again picking up where our last conversation with him left off, talking about ADO.NET concurrency, SQL database design, dealing with Data Adapters, and a few other interesting tange...

10 Mar 200353min

Scott Hanselman

Scott Hanselman

Mark Dunn is on temporary leave in Redmond, WA this week teaching a beta Architecture class. Scott and Carl chat about .NET, C#, Reflection, Regular Expressions, Freeware, Code Sharing, Config Files, ...

3 Mar 20031h 7min

Alan Cooper

Alan Cooper

Alan has a lot to say about programming, programmers, and focuses intently on what's wrong with programming as we know it. Why do businesspeople fear programmers? Is the construction of software manag...

27 Jan 20031h 22min

Michèle Leroux Bustamante

Michèle Leroux Bustamante

Michele discusses the differences between programming in Java space vs. .NET from her own first hand experience.Support this podcast at — https://redcircle.com/net-rocks/donations

20 Jan 20031h 10min

.NET Sucess Stories Part 1

.NET Sucess Stories Part 1

This is the first of a series of shows we are going to do this year highlighting .NET Success Stories; companies that have implemented .NET applications successfully as either pilot projects or produc...

13 Jan 20031h 11min

Ken Getz

Ken Getz

Ken talks about asynchronous calls, events, delegates, the next version of Microsoft Office, printing, C# vs VB.NET, being a control freak, Visual Studio.NET 2003, and training videos.Support this pod...

23 Des 20021h 11min

Nickolas Landry

Nickolas Landry

Carl and Mark talk with Nick about Mobile computing, and how .NET fully supports mobile devices. A surprise phone call from Tim Huckaby forces us to extend this lousy show for an extra half-hour, but ...

16 Des 20021h 40min

Populært innen Teknologi

lydartikler-fra-aftenposten
romkapsel
tomprat-med-gunnar-tjomlid
teknisk-sett
energi-og-klima
elektropodden
shifter
fornybaren
hans-petter-og-co
rss-impressions-2
nasjonal-sikkerhetsmyndighet-nsm
teknologi-og-mennesker
rss-alt-som-gar-pa-strom
rss-ai-forklart
kunstig-intelligens-med-morten-goodwin
rss-bouvet-bobler
pedagogisk-intelligens
rss-for-alarmen-gar
rss-brukbart
rss-grenser-for-ki