Welcome to Eye on AI, the podcast that keeps you informed about the latest trends, obstacles, and possibilities in the realm of artificial intelligence. In this episode, we have the privilege of engaging in a thought-provoking discussion with Aidan Gomez, an exceptional AI developer and co-founder of Cohere.
Aidan’s passion lies in enhancing the efficiency of massive neural networks and effectively deploying them in the real world. Drawing from his vast experience, which includes leading a team of researchers at For.ai and conducting groundbreaking research at Google Brain, Aidan provides us with unique insights and anecdotes that shed light on the AI landscape.
During our conversation, Aidan explains his collaboration with the legendary Geoffrey Hinton and their remarkable project at Google Brain. We delve into the intricate architecture of AI systems, demystifying the construction of the transformative transformer algorithm. Aidan generously shares his knowledge on the creation of attention within these models and the complexities of scaling such systems.
As we explore the fascinating domain of language models, Aidan discusses their learning process, bridging the gap between code and data. We uncover the immense potential of these models to suggest other large-scale counterparts. We gain invaluable insights into Aidan’s journey as a co-founder of Cohere, an innovative platform revolutionizing the utilization of language technology.
Tune in to Eye on AI now to immerse yourself in a captivating conversation that will expand your understanding of this ever-develop field.
(00:00) Preview
(00:33) Introduction & sponsorship
(02:00) Aidan's background with machine learning & AI
(05:10) Geoffrey Hinton & Aidan Gomez working together
(07:55) Aidan Gomez & Google Brain's project
(12:53) Aidan's role in building AI architecture
(15:25) How the transformer algorithm is built
(18:25) How do you create attention?
(20:40) How do you scale the model?
(25:10) How language models learn from code and data
(29:55) Did you know the potential of the project?
(34:15) Can LLMs suggest other large models?
(36:45) How Aidan Gomez started Cohere
(41:10) How do people use Cohere?
(46:50) Examples of language technology models
(48:40) How Cohere handles hallucinations
(52:53) The dangers of AI
Craig Smith Twitter: https://twitter.com/craigss
Eye on A.I. Twitter: https://twitter.com/EyeOn_AI
#185 Damon Rasheed & Saurabh Jain: Achieving Up to 90% Accuracy in Predicting Drug Clinical Trial Outcomes with Opyl's Trialkey.ai
#184 André van Schaik: Building An Artificial Brain With 100 Billion Neurons
#183 Will Falcon: Lightning Studio, an iOS for AI Developers?
#182 Dragomir Anguelov: The Role of AI and Machine Learning in Waymo's Self-Driving Cars
#181 Nick Bostrom: The Meaning of Life in a World where AI can do Everything for Us
#180 Thomas Lah: Navigating AI Adoption in Tech Businesses
#179 Ylli Bajraktari: AI and National Security - The Race with China
#178 Terry Sejnowski on Integrating Human Development Principles into AI Models
#177 Björn Ommer: Diffusion Mods Explained By Stable Diffusion’s Creator
#176 Sergey Levine: Decoding The Evolution of AI in Robotics
#175 Aravind Srinivas: Revolutionizing Search with Perplexity AI
#174 Tianmin Shu: How World Models are Shaping The Future of AI
#173 Vincent Vanhoucke: How Is AI Helping Advance Robotics?
#172 Cristóbal Valenzuela: Can AI Revolutionize How We Create Art?
#171 Anna Marie Wagner: Harnessing AI for Synthetic Biology
#170 Richard Sutton on Pursuing AGI Through Reinforcement Learning
#169 Guillermo Rauch: How To Use AI to Improve Web Development
#168 Ian Bremmer on Regulating AI for a Safer Future
#167 Matt Powell: The Impact of AI on Security and Surveillance
#166 Itamar Arel: Is Voice AI the Future of Customer Service?
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Lex Fridman Podcast