Phillip Carter, Principal Product Manager at Honeycomb and open source software developer, talks with host Giovanni Asproni about observability for large language models (LLMs). The episode explores similarities and differences for observability with LLMs versus more conventional systems. Key topics include: how observability helps in testing parts of LLMs that aren't amenable to automated unit or integration testing; using observability to develop and refine the functionality provided by the LLM (observability-driven development); using observability to debug LLMs; and the importance of incremental development and delivery for LLMs and how observability facilitates both. Phillip also offers suggestions on how to get started with implementing observability for LLMs, as well as an overview of some of the technology's current limitations. This episode is sponsored by WorkOS.
Episode 518: Karl Wiegers on Software Engineering Lessons
Episode 517: Jordan Adler on Code Generators
Episode 516: Brian Okken on Testing in Python with pytest
Edpisode 515: Swizec Teller on Becoming a Senior Engineer
Episode 514: Vandana Verma on the Owasp Top 10
Episode 513: Gil Hoffer on Applying DevOps Practices to Managing Business Applications
Episode 512: Tim Post on Rubber Duck Debugging
Episode 511: Ant Wilson on Supabase (Postgres as a Service)
Episode 510: Deepthi Sigireddi on How Vitess Scales MySQL
Episode 509: Matt Butcher and Matt Farina on Helm Charts
Episode 508: Jérôme Laban on Cross Platform UI
Episode 507: Kevin Hu on Data Observability
Episode 506: Rob Hirschfeld on Bare Metal Infrastructure
Episode 505: Daniel Stenberg on 25 years with cURL
Episode 504: Frank McSherry on Materialize
Episode 503: Diarmuid McDonnell on Web Scraping
Episode 502: Omer Katz on Distributed Task Queues Using Celery
Episode 501: Bob Ducharme on Creating Technical Documentation for Software Projects
Episode 500: Sergey Gorbunov on Blockchain Interoperability
Episode 499: Uma Chingunde on Building a PaaS
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Lex Fridman Podcast