In this episode, I had the pleasure of speaking with Jason Liu, an applied AI consultant and the creator of Instructor – an open-source tool for extracting structured data from LLM outputs. We chat about LLM applications, their challenges, and how to overcome them. We also dive into Instructor, making LLMs interact with existing systems and a bunch of other cool things. Join our Discord community: https://discord.gg/tEYvqxwhah ➡️ Jason Liu on Twitter – https://twitter.com/jxnlco 🤖 Instructor Blog – https://jxnl.github.io/instructor/ 🌐 Check Out Our Website! https://dagshub.com Social Links: ➡️ LinkedIn: https://www.linkedin.com/company/dagshub ➡️ Twitter: https://twitter.com/TheRealDAGsHub ➡️ Dean Pleban: https://twitter.com/DeanPlbn
Timestamps: 00:00 Introduction 02:18 Excitement about Machine Learning and AI 03:28 Using LLMs as Backend Developers 04:22 Building Applications with LLMs 07:07 Building Instructor 09:30 Thinking in Logic and Design 10:33 Validating Data and Building Systems with Instructor 11:49 Thoughts About Product and UX in LLMs 17:51 Future of Instructor 20:25 Misconceptions and Unsolved Problems in LLMs 24:57 Improving LLM Applications 26:14 RAG as Recommendation Systems 29:32 Fine-tuning Embedding Models 32:32 Beyond Vector Similarity in RAG 39:32 Predictions for the Next Year in AI and ML 45:26 Measuring Impact on Business Outcomes 47:06 The Continuous Cycle of Machine Learning 48:38 Unlocking Economic Value through Structured Data Extraction 50:52 Questioning the Status Quo and Making an Impact
🌊 AI-Native with Idan Gazit – The future of AI products and interfaces + Getting AI to production
🍪 Machine Learning in the cookie-less era with Uri Goren
🛰️ Modern & Realistic MLOps with Han-chung Lee
🩻 AI in Medical Devices & Medicine with Mila Orlovsky
🔴 Live MLOps Podcast – Building, Deploying and Monitoring Large Language Models with Jinen Setpal
Live MLOps Podcast Episode!
⛹️♂️ Large Scale Video ML at WSC Sports with Yuval Gabay
🤖 GPTs & Large Language Models in production with Hamel Husain
🫣 Is Data Science a dying job? with Almog Baku
🏃♀️Moving Fast and Breaking Data with Shreya Shankar
🚴♀️ Quick & Dirty Machine Learning with Noa Weiss
✍️ Building ML Teams and Platforms with Assaf Pinhasi
🎨 Stable Diffusion and generative models with David Marx
🔴🟢🟣Julia Language in Production with Logan Kilpatrick
🛠 Building tools for MLOps with Guy Smoilovsky
📈 You Have Too Much Data with Dean Langsam
🏗 Reasonable Scale MLOps with Jacopo Tagliabue
🦾 Made With ML - Learning How to Apply MLOps with Goku Mohandas
🤹♀️ Building models that actually perform with Kyle Gallatin
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Lex Fridman Podcast