This episode is sponsored by Crusoe. Crusoe Cloud is a scalable, clean, high-performance cloud, optimized for AI and HPC workloads, and powered by wasted, stranded or clean energy. Crusoe offers virtualized compute and storage solutions for a range of applications - including generative AI, computational biology, and rendering.
Visit https://crusoecloud.com/ to see what climate-aligned computing can do for your business
This episode is sponsored by Celonis ,the global leader in process mining. AI has landed and enterprises are adapting. To give customers slick experiences and teams the technology to deliver. The road is long, but you’re closer than you think. Your business processes run through systems. Creating data at every step. Celonis recontrusts this data to generate Process Intelligence. A common business language. So AI knows how your business flows. Across every department, every system and every process.
Go to https:/celonis.com/eyeonai/ to find out more.
Welcome to episode 147 of the Eye on AI podcast. In this episode, host Craig Smith sits down with Yilna Du, a final year PhD student at MIT EECS with a background in research at leading institutions like OpenAI, FAIR, and Google Deepmind.
Yilun's extensive expertise spans generative models, decision making, robot learning, and embodied agents, making him a valuable voice in the AI domain.
Our conversation kicks off with a brief on Yilun's academic journey, leading into a deep dive into Reinforcement Learning with AI feedback (RLHF) - its history, inception, and challenges. We then touch upon the effectiveness of RLHF, the intriguing concept of multi-agent debate, and the PAPES procedure.
Craig and Yilun further explore the vast realm of AI, debating the gaps between open-source and proprietary models, the need for more compute resources, and the future of robotics interlaced with AI. Yilun provides a glimpse into his vision of decentralized AI systems, contrasting the industry's commercial trajectory with academia.
Craig Smith Twitter: https://twitter.com/craigss
Eye on A.I. Twitter: https://twitter.com/EyeOn_AI
(00:00) Preview, Celonis and Crusoe Ad
(04:06) Yilun's Academic Background
(05:52) Origin and Applications of RLHF
(12:16) ROHF and the Multi-Agent Debate Method
(17:32) AI Model Interaction without Human Intervention?
(20:41) Applicability and Inconsistency Detection
(28:43) The Future of AI Training
(45:26) Robotics and Decentralized AI Systems
#185 Damon Rasheed & Saurabh Jain: Achieving Up to 90% Accuracy in Predicting Drug Clinical Trial Outcomes with Opyl's Trialkey.ai
#184 André van Schaik: Building An Artificial Brain With 100 Billion Neurons
#183 Will Falcon: Lightning Studio, an iOS for AI Developers?
#182 Dragomir Anguelov: The Role of AI and Machine Learning in Waymo's Self-Driving Cars
#181 Nick Bostrom: The Meaning of Life in a World where AI can do Everything for Us
#180 Thomas Lah: Navigating AI Adoption in Tech Businesses
#179 Ylli Bajraktari: AI and National Security - The Race with China
#178 Terry Sejnowski on Integrating Human Development Principles into AI Models
#177 Björn Ommer: Diffusion Mods Explained By Stable Diffusion’s Creator
#176 Sergey Levine: Decoding The Evolution of AI in Robotics
#175 Aravind Srinivas: Revolutionizing Search with Perplexity AI
#174 Tianmin Shu: How World Models are Shaping The Future of AI
#173 Vincent Vanhoucke: How Is AI Helping Advance Robotics?
#172 Cristóbal Valenzuela: Can AI Revolutionize How We Create Art?
#171 Anna Marie Wagner: Harnessing AI for Synthetic Biology
#170 Richard Sutton on Pursuing AGI Through Reinforcement Learning
#169 Guillermo Rauch: How To Use AI to Improve Web Development
#168 Ian Bremmer on Regulating AI for a Safer Future
#167 Matt Powell: The Impact of AI on Security and Surveillance
#166 Itamar Arel: Is Voice AI the Future of Customer Service?
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Lex Fridman Podcast