Phillip Carter, Principal Product Manager at Honeycomb and open source software developer, talks with host Giovanni Asproni about observability for large language models (LLMs). The episode explores similarities and differences for observability with LLMs versus more conventional systems. Key topics include: how observability helps in testing parts of LLMs that aren't amenable to automated unit or integration testing; using observability to develop and refine the functionality provided by the LLM (observability-driven development); using observability to debug LLMs; and the importance of incremental development and delivery for LLMs and how observability facilitates both. Phillip also offers suggestions on how to get started with implementing observability for LLMs, as well as an overview of some of the technology's current limitations. This episode is sponsored by WorkOS.
Episode 478: Satish Mohan on Network Segmentation
Episode 477: Josef Strzibny on Self Hosting Applications
Episode 476: Leonid Shevtsov on Transactional Email
Episode 475: Rey Bango on Secure Coding Veracode
Episode 474: Paul Butcher on Fuzz Testing
Episode 473: Mike Del Balso on Feature Stores
Episode 472: Liran Haimovitch on Handling Customer Issues
Episode 471: Jason Meller on Choosing the Right Tech Stack for a Greenfield Project
Episode 470: L. Peter Deutsch on the Fallacies of Distributed Computing
Episode 469: Dhruba Borthakur on Embedding Real-time Analytics in Applications
Episode 468: Iljitsch van Beijnum on Internet Routing and BGP
Episode-467-Kim-Carter-on-Dynamic-Application-Security-Testing
Episode 466: Casey Aylward on Venture Capital for Software Investing
Episode 465: Kevlin Henney and Trisha Gee on 97 Things Every Java Programmer Should Know
Episode 464: Rowland Savage on Getting Acquired
Episode 463: Yaniv Tal on Web 3.0 and the Graph
Episode 462: Felienne on the Programmers Brain
Episode 461 Michael Ashburne and Maxwell Huffman on Quality Assurance
Episode 460: Evan Weaver on FaunaDB
Episode 459: Otakar Nieder on Gaming vs Simulation Engines
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Lex Fridman Podcast