Azure API Management's GenAI Gateway with Andrei Kamenev
.NET Rocks!7 Aug 2024

Azure API Management's GenAI Gateway with Andrei Kamenev

How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Episoder(1994)

Scott Stanfield

Scott Stanfield

Scott talks about the human side of software development, the .NET Pet Shop wars; a now famous head-to-head battle between .NET and Java, and talks about his company, Vertigo Software, and the work th...

9 Des 20021h 2min

Chris Sells

Chris Sells

Chris talks with Test with Carl and Mark about COM and .NET components, finalizers, disposing, Smart Client Windows Forms Applications (we still don't know what to call these things), how to navigate ...

2 Des 20021h 32min

Dev Connections

Dev Connections

.NET Rocks! went on the road to VS.NET Connections, an awesome .NET developer conference in Orlando, FL that took place October 27-30, 2002. We have two hours of interviews with speakers and attendees...

28 Okt 200255min

Bill Vaughn

Bill Vaughn

Carl and Mark talk to bill about ADO.NET, DataAdapters, Yukon, Concurrency, JET (Bill Hates Jet), MSDE, DTS, and other critical stuff. This is classic Vaughn!This is also the genesis of the messy hair...

14 Okt 20021h 10min

Mark Anders

Mark Anders

Carl and Mark talk with Mark Anders about ASP.NET, Framework v1.1, Languages, IIS 6.0, and other great topics. This week we had some celebrity callers: Chris Sells and MSDN Regional Director Stephen F...

7 Okt 20021h 7min

Jonathan Zuck

Jonathan Zuck

Carl and Mark have a great chat with Jonathan Zuck about protecting the free market system from anti-competitive legislation championed by companies that want to use Washington to limit the power and ...

30 Sep 20021h 3min

Juval Löwy

Juval Löwy

Carl and Mark have an enlightening talk with Juval Löwy about COM+ Enterprise Services, and how they relate to .NET. If you thought Enterprise Services (COM+) was just about Transactions and Object Po...

23 Sep 200245min

Billy Hollis

Billy Hollis

This week Carl and Mark interview Billy Hollis, noted speaker and .NET expert. Billy and Rockford Lhotka had the first VB.NET book on the market from Wrox Press. Since then, Billy has taught VB.NET cl...

16 Sep 200259min

Populært innen Teknologi

lydartikler-fra-aftenposten
romkapsel
tomprat-med-gunnar-tjomlid
teknisk-sett
energi-og-klima
elektropodden
shifter
fornybaren
hans-petter-og-co
rss-impressions-2
nasjonal-sikkerhetsmyndighet-nsm
teknologi-og-mennesker
rss-alt-som-gar-pa-strom
rss-ai-forklart
kunstig-intelligens-med-morten-goodwin
rss-bouvet-bobler
pedagogisk-intelligens
rss-for-alarmen-gar
rss-brukbart
rss-grenser-for-ki