Phillip Carter, Principal Product Manager at Honeycomb and open source software developer, talks with host Giovanni Asproni about observability for large language models (LLMs). The episode explores similarities and differences for observability with LLMs versus more conventional systems. Key topics include: how observability helps in testing parts of LLMs that aren't amenable to automated unit or integration testing; using observability to develop and refine the functionality provided by the LLM (observability-driven development); using observability to debug LLMs; and the importance of incremental development and delivery for LLMs and how observability facilitates both. Phillip also offers suggestions on how to get started with implementing observability for LLMs, as well as an overview of some of the technology's current limitations. This episode is sponsored by WorkOS.
SE Radio 615: Kent Beck on "Tidy First?"
SE Radio 613: Shahar Binyamin on GraphQL Security
SE Radio 614: Wouter Groeneveld on Creative Problem Solving for Software Development
SE Radio 612: Eyal Solomon on API Consumption Management
SE Radio 611: Ines Montani on Natural Language Processing
SE Radio 603: Rishi Singh on Using GenAI for Test Code Generation
SE Radio 609: Hyrum Wright on Software Engineering at Google
SE Radio 608: Lane Wagner on Revisiting the Go Language
SE Radio 607: John Frandsen on Geospatial Technologies
SE Radio 606: Charlie Jones on Third-Party Software Supply Chain Risks
SE Radio 605: Yingjun Wu on Streaming Databases
SE Radio 604: Karl Wiegers and Candase Hokanson on Software Requirements Essentials
SE Radio 602: Nicolas Carlo on Improving Legacy Code
SE Radio 601: Han Yuan on Reorganizations
SE Radio 600: William Morgan on Kubernetes Sidecars and Service Mesh
SE Radio 599: Jason C. McDonald on Quantified Tasks
SE Radio 598: Jonathan Crossland on the AMMERSE Framework
SE Radio 597: Coral Calero Muñoz and Félix García on Green Software
SE Radio 596: Maxim Fateev on Durable Execution with Temporal
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Darknet Diaries