Phillip Carter, Principal Product Manager at Honeycomb and open source software developer, talks with host Giovanni Asproni about observability for large language models (LLMs). The episode explores similarities and differences for observability with LLMs versus more conventional systems. Key topics include: how observability helps in testing parts of LLMs that aren't amenable to automated unit or integration testing; using observability to develop and refine the functionality provided by the LLM (observability-driven development); using observability to debug LLMs; and the importance of incremental development and delivery for LLMs and how observability facilitates both. Phillip also offers suggestions on how to get started with implementing observability for LLMs, as well as an overview of some of the technology's current limitations. This episode is sponsored by WorkOS.
SE Radio 578: Ori Mankali on Secrets Management using Distributed Fragments Cryptography
SE Radio 577: Casey Muratori on Clean Code, Horrible Performance?
SE Radio 576: Jens Neuse on Back Ends for Front Ends
SE Radio 575: Nir Valtman on Pipelineless Security
SE Radio 574: Chad Michel on Software as an Engineering Discipline
SE Radio 573: Varun Singh on Evolution of Internet Protocols
SE Radio 572: Gregory Kapfhammer on Flaky Tests
SE Radio 571: Jeroen Mulder on Multi-Cloud Governance
SE Radio 570: Stanisław Barzowski on the jsonnet Language
SE Radio 569: Vladyslav Ukis on Rolling out SRE in an Enterprise
SE Radio 568: Simon Bennetts on OWASP Dynamic Application Security Testing Tool ZAP
SE Radio 567: Dave Cross on GitHub Actions
SE Radio 566: Ashley Peacock on Diagramming in Software Engineering
SE Radio 565: Luca Galante on Platform Engineering
SE Radio 564: Paul Hammant on Trunk-Based Development
SE Radio 563: David Cramer on Error Tracking
SE Radio 562: Bastian Gruber on Rust Web Development
SE Radio 561: Dan DeMers on Dataware
SE Radio 560: Sugu Sougoumarane on Distributed SQL with Vitess
SE Radio 559: Ross Anderson on Software Obsolescence
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Lex Fridman Podcast