Azure API Management's GenAI Gateway with Andrei Kamenev
.NET Rocks!7 Aug 2024

Azure API Management's GenAI Gateway with Andrei Kamenev

How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Episoder(1954)

Shaun Walker on DotNetNuke 4.x

Shaun Walker on DotNetNuke 4.x

Shaun Walker is back to talk about advances in DotNetNuke, his incredible open-source ASP.NET framework. .NET Nuke has been an increasingly popular option for development of ASP.NET sites and applications ever since it arrived on the scene in the early days of .NET.Support this podcast at — https://redcircle.com/net-rocks/donations

13 Mar 20071h 3min

Dare Obasanjo on Windows Live Services and Other Cool Projects

Dare Obasanjo on Windows Live Services and Other Cool Projects

Dare Obasanjo talks to us about his work with Windows Live Server technologies, Windows Live Messenger, and RSS Bandit, his open source RSS aggregator.Support this podcast at — https://redcircle.com/net-rocks/donations

8 Mar 20071h 9min

Paul Randal on SQL Server 2005 Performance and Recovery

Paul Randal on SQL Server 2005 Performance and Recovery

Microsoftee Paul Randal drops by for an engaging talk about his contributions to the recoverability of SQL Server 2005, which are many (Can you say CHECKDB?). An old friend of ours, and a fairly new friend if Paul's, busts in on the conversation and makes a cameo appearance.Support this podcast at — https://redcircle.com/net-rocks/donations

6 Mar 20071h 9min

Eric Sink on Vista, Writing Books, SourceGear, and Wii Golf

Eric Sink on Vista, Writing Books, SourceGear, and Wii Golf

Eric Sink talks to us this week about a number of things currently on his mind including software methodologies, getting involved in the business side of software, upgrading to Vista, WPF/E, writing books for a living, and the evolution of his product, SourceGear.Support this podcast at — https://redcircle.com/net-rocks/donations

27 Feb 20071h 15min

Steve McConnell Makes Sure We're Code Complete

Steve McConnell Makes Sure We're Code Complete

Steve McConnell talks about his books, and his take on programming practices that transcend specific languages.Support this podcast at — https://redcircle.com/net-rocks/donations

19 Feb 20071h 34min

Billy Hollis on Application Complexity

Billy Hollis on Application Complexity

In this episode, Billy Hollis talks about the finer points of developing complex applications in the real world, the true costs and benefits of agile and other methodologies, and the things programmers and organizations can do to be effecient financially.Support this podcast at — https://redcircle.com/net-rocks/donations

13 Feb 20071h 15min

Jesse Liberty and Alex Horovitz on .NET 3.0

Jesse Liberty and Alex Horovitz on .NET 3.0

Jesse Liberty and Alex Horovitz talk about their experiences researching and writing their book, Programming .NET 3.0 from O'Reilly, as well as their ideas on the future of programming.Support this podcast at — https://redcircle.com/net-rocks/donations

6 Feb 20071h 24min

Allan Hirt on High Availability

Allan Hirt on High Availability

Allan Hirt discusses the details of providing high availability with SQL Server 2005, and the things developers need to know in order to make their applications compatable. He discusses clustering, transaction log shipping, mirroring, and more.Support this podcast at — https://redcircle.com/net-rocks/donations

30 Jan 20071h 14min

Populært innen Teknologi

smart-forklart
romkapsel
rss-avskiltet
teknisk-sett
tomprat-med-gunnar-tjomlid
kunstig-intelligens-med-morten-goodwin
rss-impressions-2
nasjonal-sikkerhetsmyndighet-nsm
shifter
energi-og-klima
teknologi-og-mennesker
fotopodden
rss-for-alarmen-gar
i-loopen
rss-snakk-om-sikkerhet
rss-var-alt-bedre-for
fornybaren
rss-digitaliseringspadden
rss-30-minutter-inn-i-fremtiden
rss-tendencast-kunstig-intelligens-og-juss