You’ve got a machine learning model trained and running in production, but that’s only half of the battle. Are you certain that it is still serving the predictions that you tested? Are the inputs within the range of tolerance that you designed? Monitoring machine learning products is an essential step of the story so that you know when it needs to be retrained against new data, or parameters need to be adjusted. In this episode Emeli Dral shares the work that she and her team at Evidently are doing to build an open source system for tracking and alerting on the health of your ML products in production. She discusses the ways that model drift can occur, the types of metrics that you need to track, and what to do when the health of your system is suffering. This is an important and complex aspect of the machine learning lifecycle, so give it a listen and then try out Evidently for your own projects.
AnnouncementsThe intro and outro music is from Requiem for a Fish The Freak Fandango Orchestra / CC BY-SA
Update Your Model's View Of The World In Real Time With Streaming Machine Learning Using River
Declarative Machine Learning For High Performance Deep Learning Models With Predibase
Build Better Machine Learning Models With Confidence By Adding Validation With Deepchecks
Build A Full Stack ML Powered App In An Afternoon With Baseten
Skip Straight To The Fun Part Of Your Project With PyScaffold
Add Configuration Best Practices To Your Application In An Afternoon With Dynaconf
Take A Tour Of The Hidden Language Of Hardware And How It Powers Your Code
Take Control Of Your Electrical Systems With The Open Source FlexMeasures Energy Management System
How And Why To Build Effective Teams As An Engineering Leader
Complete Your Hardware "Weekend Projects" In An Actual Weekend With Belay
Catching Up With Pyre, A Fast Type Checker For Python
Standardizing On Python For All Software Projects At Ascend.io
Exploring The Process And Practice Of Building Better Software Through Code Reviews
Ship With Confidence By Automating Quality Assurance
Remove Roadblocks And Let Your Developers Ship Faster With Self-Serve Infrastructure
The Benefits Of Python And Django For Going From Zero To MVP At Speed
Powering The Next Generation Of Application Architectures With Web Assembly And The Fermyon Platform
Gain A Deeper Understanding Of What Your Code Is Doing And Where It Spends Its Time With VizTracer
Stream Processing In Real Time And At Scale In Pure Python With Bytewax
Tetra: A Full Stack Web Framework That Doesn't Make You Write Everything Twice
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Lex Fridman Podcast