Measuring LLMs with Jodie Burchell
.NET Rocks!3 Huhti

Measuring LLMs with Jodie Burchell

How do you measure the quality of a large language model? Carl and Richard talk to Dr. Jodie Burchell about her work measuring large language models for accuracy, reliability, and consistency. Jodie talks about the variety of benchmarks that exist for LLMs and the problems they have. A broader conversation about quality digs into the idea that LLMs should be targeted to the particular topic area they are being used for - often, smaller is better! Building a good test suite for your LLM is challenging but can increase your confidence that the tool will work as expected.

Jaksot(1974)

Ken Levy on Visual Studio Extensibility (VSX)

Ken Levy on Visual Studio Extensibility (VSX)

Carl and Richard talk VSX with Ken Levy who these days is all about community and showing developers how to extend Visual Studio.Support this podcast at — https://redcircle.com/net-rocks/donations

1 Tammi 20081h 1min

Jeff Prosise Goes Deep on Silverlight

Jeff Prosise Goes Deep on Silverlight

Carl and Richard talk Silverlight with Jeff Prosise.Support this podcast at — https://redcircle.com/net-rocks/donations

27 Joulu 20071h 10min

Joe Duffy on the Task Parallel Library

Joe Duffy on the Task Parallel Library

Carl and Richard talk to Microsoft's Joe Duffy about the Task Parallel Library, which promises to make multi-threaded programming easier for us all.Support this podcast at — https://redcircle.com/net-rocks/donations

25 Joulu 20071h 8min

Richard Campbell Tells All!

Richard Campbell Tells All!

It's our 300th show! Can you believe it? Carl interviews Richard, who tells many stories of his experiences in electronics and computers. Don't miss the funny stories!Support this podcast at — https://redcircle.com/net-rocks/donations

20 Joulu 20071h 15min

Jeff Palermo on ASP.NET MVC

Jeff Palermo on ASP.NET MVC

Jeff Palermo introduces the nascent ASP.NET Model View Controler Framework. He easily explains the benefits, pitfalls, and techniques you can use to implement a MVC pattern in ASP.NET.Support this podcast at — https://redcircle.com/net-rocks/donations

19 Joulu 20071h 5min

Gael Fraiteur on PostSharp

Gael Fraiteur on PostSharp

Carl and Richard chat with Gael Fraiteur about PostSharp, an AOP framework and toolkit for .NET.Support this podcast at — https://redcircle.com/net-rocks/donations

13 Joulu 20071h 5min

Tomas Petricek on PHP in ASP.NET and Silverlight!

Tomas Petricek on PHP in ASP.NET and Silverlight!

Carl and Richard talk to Tomas Petricek about Phalanger, a managed code PHP language compiler, as well as his thoughts on F# Web Tools, a toolkit which lets you write both client-side and server-side code at the same time, and the client gets converted to JavaScript.Support this podcast at — https://redcircle.com/net-rocks/donations

11 Joulu 200757min

Open Source Panel Discussion at DevTeach, Vancouver

Open Source Panel Discussion at DevTeach, Vancouver

Carl and Richard host a panel discussion on open source software at the DevTeach developer conference in Vancouver, BC. Panelists: Rod Paddock, Shaun Walker, Rob Chartier, and Sara Ford.Support this podcast at — https://redcircle.com/net-rocks/donations

6 Joulu 20071h 17min