Phillip Carter, Principal Product Manager at Honeycomb and open source software developer, talks with host Giovanni Asproni about observability for large language models (LLMs). The episode explores similarities and differences for observability with LLMs versus more conventional systems. Key topics include: how observability helps in testing parts of LLMs that aren't amenable to automated unit or integration testing; using observability to develop and refine the functionality provided by the LLM (observability-driven development); using observability to debug LLMs; and the importance of incremental development and delivery for LLMs and how observability facilitates both. Phillip also offers suggestions on how to get started with implementing observability for LLMs, as well as an overview of some of the technology's current limitations. This episode is sponsored by WorkOS.
Episode 438: Andy Powell on Lessons Learned from a Major Cyber Attack
Episode 437: Architecture of Flutter
Episode 436: Apache Samza with Yi Pan
Episode 435: Julie Lerman on Object Relational Mappers and Entity Framework
Episode 434: Steven Skiena on Preparing for the Data Structures and Algorithm Job Interview
Episode 433: Jay Kreps on ksqlDB
Episode 432: brian d foy on Perl 7
Episode 431: Ken Youens-Clark on Learning Python
Episode 430: Marco Faella on Seriously Good Software
Episode 429: Rob Skillington on High Cardinality Alerting and Monitoring
Episode 428: Matt Lacey on Mobile App Usability
Episode 427: Sven Schleier and Jeroen Willemsen on Mobile Application Security
Episode 426: Philip Kiely on Writing for Software Developers
Episode 425: Paul Smith on The Crystal Programming Language and the Lucky Web Framework
Episode 424: Sean Knapp on Dataflow Pipeline Automation
423: Ryan Singer on Remote Work
Episode 422: Michael Geers on Micro Frontends
Episode 421: Doug Fawley on gRPC
Episode 420: Ryan Ripley on Making Scrum Work
Episode 419: John Ellithorpe on the Role of a CTO
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Lex Fridman Podcast