Phillip Carter, Principal Product Manager at Honeycomb and open source software developer, talks with host Giovanni Asproni about observability for large language models (LLMs). The episode explores similarities and differences for observability with LLMs versus more conventional systems. Key topics include: how observability helps in testing parts of LLMs that aren't amenable to automated unit or integration testing; using observability to develop and refine the functionality provided by the LLM (observability-driven development); using observability to debug LLMs; and the importance of incremental development and delivery for LLMs and how observability facilitates both. Phillip also offers suggestions on how to get started with implementing observability for LLMs, as well as an overview of some of the technology's current limitations. This episode is sponsored by WorkOS.
SE Radio 598: Jonathan Crossland on the AMMERSE Framework
SE Radio 597: Coral Calero Muñoz and Félix García on Green Software
SE Radio 596: Maxim Fateev on Durable Execution with Temporal
SE Radio 595: Llewelyn Falco on Approval Testing
SE Radio 594: Sean Moriarity on Deep Learning with Elixir and Axon
SE Radio 593: Eric Olden on Identity Orchestration
SE Radio 592: Jaxon Repp on Distributed Data Infrastructure
SE Radio 591: Yechezkel Rabinovich on Kubernetes Observability
SE Radio 590: Andy Suderman on Standing Up Kubernetes
SE Radio 589: Zac Hatfield-Dodds on Property-Based Testing in Python
SE Radio 588: José Valim on Elixir, Machine Learning, and Livebook
SE Radio 587: M. Scott Ford on Managing Dependency Freshness
SE Radio 586: Nikhil Shetty on Virtual Private Cloud
SE Radio 585: Adam Frank on Continuous Delivery vs Continuous Deployment
SE Radio 584: Charles Weir on Ruthless Security for Busy Developers
SE Radio 583: Lukas Fittl on Postgres Performance
SE Radio 582: Leo Porter and Daniel Zingaro on Learning to Program with LLMs
SE Radio 581: Zach Lloyd on Terminal Emulators
SE Radio 580: Josh Doody on Mastering Business Communication for Software Engineers
SE Radio 579: Arun Gupta on Open Source Strategy and Community
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Lex Fridman Podcast