Phillip Carter, Principal Product Manager at Honeycomb and open source software developer, talks with host Giovanni Asproni about observability for large language models (LLMs). The episode explores similarities and differences for observability with LLMs versus more conventional systems. Key topics include: how observability helps in testing parts of LLMs that aren't amenable to automated unit or integration testing; using observability to develop and refine the functionality provided by the LLM (observability-driven development); using observability to debug LLMs; and the importance of incremental development and delivery for LLMs and how observability facilitates both. Phillip also offers suggestions on how to get started with implementing observability for LLMs, as well as an overview of some of the technology's current limitations. This episode is sponsored by WorkOS.
SE Radio 559: Ross Anderson on Software Obsolescence
SE Radio 558: Michael Fazio on Modern Android Development
SE Radio 557: Timothy Beamish on React and Next.js
SE Radio 556: Alex Boten on Open Telemetry
SE Radio 555: On Freund on Upskilling
SE Radio 554: Adam Tornhill on Behavioral Code Analysis
SE Radio 553: Luca Casonato on Deno
SE Radio 552: Matt Frisbie on Browser Extensions
Episode 551: Vidal Graupera on Manager 1-1 with Direct Reports
Episode 550: J.R. Storment and Mike Fuller on Cloud FinOps (Financial Operations)
Episode 549: William Falcon Optimizing Deep Learning Models
Episode 548: Alex Hidalgo on Implementing Service Level Objectives
Episode 547: Nicholas Manson on Identity Management for Cloud Applications
Episode 546: Dietrich Ayala on the InterPlanetary File System
Episode 545: John deVadoss on Design Philosophies that Drive .NET/Azure
Episode 544: Ganesh Datta on DevOps vs Site Reliability Engineering
Episode 543: Jon Smart on Patterns and Anti-Patterns for Successful Software Delivery in Enterprises
Episode 542: Brendan Callum on Contract-Driven APIs
Episode 541: Jordan Harband and Donald Fischer on Securing the Supply Chain
Episode 540: Joe Nash on DevRel
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Lex Fridman Podcast