On episode #132 of the Eye on AI podcast, Craig Smith sits down with Scott Downes, Chief Technology Officer at Invisible Technologies. We crack open the fascinating world of large language models (LLMs).
What are the unique ways LLMs can revolutionize text cleanup, product classification, and more? Scott unpacks the power of technology like Reinforcement Learning for Human Feedback (RLHF) that expands the horizons of data collection.
This podcast is a thorough analysis of the world of language and meaning. How does language encode meaning? Can RLHF be the panacea for complex conundrums? Scott breaks down his vision about using RLHF to redefine problem-solving. We dive into the vexing concept of teaching a language model through reinforcement learning without a world model.
We discuss the future of the human workforce in AI, hear Scott’s insights on the potential shift from labellers to RLHF workers. What implications does this shift hold? Can AI elevate people to work on more complicated tasks? From exploring the economic pressure companies face to the potential for increased productivity from AI, we break down the future of work.
(00:00) Preview and introduction
(01:33) Generative AI’s Dirty Little Secret
(17:33) Large Language Models in Problem Solving
(23:24) Large Language Models and RLHF Challenges
(30:07) Teaching Language Models Through RLHF
(35:35) Language Models’ Power and Potential
(53:00) Future of Human Workforce in AI
(1:03:10) AI Changing Your World
Craig Smith Twitter: https://twitter.com/craigss
Eye on A.I. Twitter: https://twitter.com/EyeOn_AI
#185 Damon Rasheed & Saurabh Jain: Achieving Up to 90% Accuracy in Predicting Drug Clinical Trial Outcomes with Opyl's Trialkey.ai
#184 André van Schaik: Building An Artificial Brain With 100 Billion Neurons
#183 Will Falcon: Lightning Studio, an iOS for AI Developers?
#182 Dragomir Anguelov: The Role of AI and Machine Learning in Waymo's Self-Driving Cars
#181 Nick Bostrom: The Meaning of Life in a World where AI can do Everything for Us
#180 Thomas Lah: Navigating AI Adoption in Tech Businesses
#179 Ylli Bajraktari: AI and National Security - The Race with China
#178 Terry Sejnowski on Integrating Human Development Principles into AI Models
#177 Björn Ommer: Diffusion Mods Explained By Stable Diffusion’s Creator
#176 Sergey Levine: Decoding The Evolution of AI in Robotics
#175 Aravind Srinivas: Revolutionizing Search with Perplexity AI
#174 Tianmin Shu: How World Models are Shaping The Future of AI
#173 Vincent Vanhoucke: How Is AI Helping Advance Robotics?
#172 Cristóbal Valenzuela: Can AI Revolutionize How We Create Art?
#171 Anna Marie Wagner: Harnessing AI for Synthetic Biology
#170 Richard Sutton on Pursuing AGI Through Reinforcement Learning
#169 Guillermo Rauch: How To Use AI to Improve Web Development
#168 Ian Bremmer on Regulating AI for a Safer Future
#167 Matt Powell: The Impact of AI on Security and Surveillance
#166 Itamar Arel: Is Voice AI the Future of Customer Service?
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Lex Fridman Podcast