Azure API Management's GenAI Gateway with Andrei Kamenev
.NET Rocks!7 Aug 2024

Azure API Management's GenAI Gateway with Andrei Kamenev

How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Episoder(1956)

F# Moves Forward

F# Moves Forward

Carl and Richard talk to Don Syme, the inventor of F#, along with F# PM Luke Hoban and MS Researcher Ralf Herbrich about the future of the F# language.Support this podcast at — https://redcircle.com/net-rocks/donations

27 Nov 20071h 6min

Dot Net Nuke Discussion Panel

Dot Net Nuke Discussion Panel

Carl and Richard interview members of the Dot Net Nuke corporation and their partners in front of a live audience at the Connections conference in Las Vegas November, 2007.Support this podcast at — https://redcircle.com/net-rocks/donations

23 Nov 20071h 13min

Kent Alstad at Dev Connections!

Kent Alstad at Dev Connections!

Carl and Richard talk scalability with Kent Alstad live from Dev Connections in Las Vegas.Support this podcast at — https://redcircle.com/net-rocks/donations

20 Nov 20071h 18min

Tim Sneath and Ian Ellison-Taylor on Windows Past, Present and Future

Tim Sneath and Ian Ellison-Taylor on Windows Past, Present and Future

Carl and Richard talk to Windows veterans Tim Sneath and Ian Ellison-Taylor about the olden days of Windows, how it has evolved, and how it may look in the future from a developer perspective.Support this podcast at — https://redcircle.com/net-rocks/donations

15 Nov 20071h 7min

Pablo Castro on Astoria

Pablo Castro on Astoria

Pablo Castro from the SQL Server Product Group at Microsoft talks about his work with Astoria, an infrastructure for bringing web technologies and data sources together. Astoria uses the Entity Framework, which Pablo is also involved with.Support this podcast at — https://redcircle.com/net-rocks/donations

13 Nov 20071h 11min

Mark Dunn at TechEd Asia

Mark Dunn at TechEd Asia

We sent Mark to sit down with and interview the minds behind TechEd Asia.Support this podcast at — https://redcircle.com/net-rocks/donations

7 Nov 20071h 11min

Sue Mosher On Outlook

Sue Mosher On Outlook

Sue Discusses her work in Outlook and Exchange issues as well as the coding of Outlook and the new features of Outlook 2007.Support this podcast at — https://redcircle.com/net-rocks/donations

6 Nov 20071h 7min

Nikhil Kothari on Facebook.NET and Everything Else!

Nikhil Kothari on Facebook.NET and Everything Else!

Nikhil Kothari talks about his eperiences working at Microsoft on all things web, including ASP.NET controls and Facebook.NET. Just read his bio to see where we took this conversation.Support this podcast at — https://redcircle.com/net-rocks/donations

1 Nov 20071h 4min

Populært innen Teknologi

romkapsel
rss-avskiltet
teknisk-sett
tomprat-med-gunnar-tjomlid
rss-impressions-2
smart-forklart
kunstig-intelligens-med-morten-goodwin
shifter
energi-og-klima
fornybaren
fotopodden
elbil-teknisk-sett
rss-alt-vi-kan
nasjonal-sikkerhetsmyndighet-nsm
rss-rimelig-mistenkelig
teknologi-og-mennesker
i-loopen
rss-snakk-om-sikkerhet
rss-bouvet-bobler
energipafyll