Measuring LLMs with Jodie Burchell
.NET Rocks!3 Huhti

Measuring LLMs with Jodie Burchell

How do you measure the quality of a large language model? Carl and Richard talk to Dr. Jodie Burchell about her work measuring large language models for accuracy, reliability, and consistency. Jodie talks about the variety of benchmarks that exist for LLMs and the problems they have. A broader conversation about quality digs into the idea that LLMs should be targeted to the particular topic area they are being used for - often, smaller is better! Building a good test suite for your LLM is challenging but can increase your confidence that the tool will work as expected.

Jaksot(1973)

David Hayden on the Enterprise Library

David Hayden on the Enterprise Library

Carl and Richard talk to David Hayden about the new features of the Microsoft Enterprise Library 3Support this podcast at — https://redcircle.com/net-rocks/donations

9 Elo 20071h 6min

Phil Haack on Subtext and Open Source

Phil Haack on Subtext and Open Source

Carl and Richard talk to Phil Haack about his work with Subtext (a derivative of the .Text blog software package) and his work on various open source projects.Support this podcast at — https://redcircle.com/net-rocks/donations

7 Elo 20071h 11min

Sandcastle!

Sandcastle!

Carl and Richard talk to Anand Raman and David Wright about Sandcastle, an internal tool for generating code documentation that is now available to the general public.Support this podcast at — https://redcircle.com/net-rocks/donations

2 Elo 20071h 6min

Dan Ciruli's Grid Computing Redux

Dan Ciruli's Grid Computing Redux

Dan Ciruli of Digipede Technologies is back to bring us up to date with Digipede Networks, a .NET toolset for enabling grid computing.Support this podcast at — https://redcircle.com/net-rocks/donations

31 Heinä 20071h 7min

Shawn Wildermuth on Silverlight

Shawn Wildermuth on Silverlight

Shawn Wildermuth talks to Richard and Carl about Silverlight from the .NET developer's persepective.Support this podcast at — https://redcircle.com/net-rocks/donations

26 Heinä 20071h 7min

Xiine with Markus Egger

Xiine with Markus Egger

Carl and Richard discuss with Marcus his new product Xiine, a next gen digital reading platform, DRM and the current state of publishing.Support this podcast at — https://redcircle.com/net-rocks/donations

24 Heinä 20071h 5min

Nick Landry on Robotics Studio

Nick Landry on Robotics Studio

Nick Landry from Infusion calls in to discuss his experiences with (and knowledge of) the somewhat new Microsoft Robotics Studio.Support this podcast at — https://redcircle.com/net-rocks/donations

19 Heinä 20071h 3min

Catching up with Miguel de Icaza

Catching up with Miguel de Icaza

Miguel de Icaza is back to tell us what's new with the Mono project, an open source implementation of the .NET Framework based on FreeBSD with support for Windows, Mac, and Linux.Support this podcast at — https://redcircle.com/net-rocks/donations

17 Heinä 20071h 10min