Practical AI: Machine Learning, Data Science
Technology:Software How-To
What is the model lifecycle like for experimenting with and then deploying generative AI models? Although there are some similarities, this lifecycle differs somewhat from previous data science practices in that models are typically not trained from scratch (or even fine-tuned). Chris and Daniel give a high level overview in this effort and discuss model optimization and serving.
Leave us a comment
Changelog++ members save 2 minutes on this episode because they made the ads disappear. Join today!
Sponsors:
Featuring:
Show Notes:
Something missing or broken? PRs welcome!
Timestamps:
(00:07) - Welcome to Practical AI
(00:43) - Daniel at GopherCon & IIC
(03:31) - Local inference & TDX
(08:23) - Cloudflare Workers AI
(09:43) - Implementing new models
(16:14) - Sponsor: Neo4j
(17:11) - Navigating HuggingFace
(20:21) - Model Sizes
(24:34) - Running the model
(30:20) - Model optimization
(34:17) - Cloud vs local
(39:26) - Cloud standardization
(43:00) - Open source go-to tools
(46:21) - Keep trying!
(48:18) - Outro
Create your
podcast in
minutes
It is Free