Azure API Management's GenAI Gateway with Andrei Kamenev
.NET Rocks!7 Aug 2024

Azure API Management's GenAI Gateway with Andrei Kamenev

How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(2016)

Controlling your Digital Legacy with Mattias Karlsson

Controlling your Digital Legacy with Mattias Karlsson

Ready for a rant? Carl and Richard talk to Billy Hollis about the impact of artificial intelligence on software development. The conversation starts with a listener comment about going all-in on AI to...

5 Sep 53min

RockBot with Rocky Lhotka

RockBot with Rocky Lhotka

How about a cloud-native AI assistant? That's RockBot! Carl and Richard talk with Rocky Lhotka about RockBot, Rocky's own variant of the OpenClaw/Hermes type personal assistant. Rocky talks about bein...

4 Sep 1h 8min

Post-Quantum Crypto with Michael Howard

Post-Quantum Crypto with Michael Howard

Whether quantum computers are around the corner or not, the message is clear: the time for post-quantum cryptography is coming fast. Carl and Richard talk to Michael Howard about Microsoft's efforts t...

3 Sep 1h 5min

Numerics.NET with Jeffrey Sax

Numerics.NET with Jeffrey Sax

So what can numerics do for you? Carl and Richard talk to Jeffrey Sax about his work building Numerics.NET, a collection of general-purpose mathematical and statistical classes built for .NET. Jeffrey...

3 Sep 1h 5min

Constraining Agents for Software Development with Don Demcsak

Constraining Agents for Software Development with Don Demcsak

How can constraints make software development assistants more efficient? Carl and Richard talk to Don Demcsak about his work on getting LLMs to build higher-quality software with fewer resources. Don ...

2 Sep 1h

Arguing about AI with Billy Hollis

Arguing about AI with Billy Hollis

Ready for a rant? Carl and Richard talk to Billy Hollis about the impact of artificial intelligence on software development. The conversation starts with a listener comment about going all-in on AI to...

26 Aug 1h 3min

Beside, Inside, and Outside AI with Chad Michel

Beside, Inside, and Outside AI with Chad Michel

What's the best way to interact with an LLM in applications? Carl and Richard talk to Chad Michel about the evolving user interface to large language models. Chad recalls Build 2023, where Technical F...

20 Aug 56min

OpenClaw with David Guttman

OpenClaw with David Guttman

What can OpenClaw do for you? Carl and Richard talk to David Guttman about his work on OpenClaw, and helping others be successful with it.OpenClaw was one of the first personal agents released and has...

12 Aug 57min

Populärt inom Teknik

uppgang-och-fall
elbilsveckan
bilar-med-sladd
market-makers
rss-elektrikerpodden
rss-laddstationen-med-elbilen-i-sverige
 och-bilen-gar-bra
skogsforum-podcast
natets-morka-sida
rss-en-ai-till-kaffet
rss-technokratin
rss-it-sakerhetspodden
klocksnack-tillsammans-med-nymans-ur-1851
rss-uppgang-och-fall
hej-bruksbil
solcellskollens-podcast
rss-veckans-ai
ai-sweden-podcast
rss-upplyst-entreprenordirektor
rss-elektrifieringspodden