Today we’re joined by Jilei Hou, a VP of Engineering at Qualcomm Technologies. In our conversation with Jilei, we focus on the emergence of generative AI, and how they've worked towards providing these models for use on edge devices. We explore how the distribution of models on devices can help amortize large models' costs while improving reliability and performance and the challenges of running machine learning workloads on devices, including model size and inference latency. Finally, Jilei we explore how these emerging technologies fit into the existing AI Model Efficiency Toolkit (AIMET) framework.
The complete show notes for this episode can be found at twimlai.com/go/633
Open Source Generative AI at Hugging Face with Jeff Boudier - #624
Generative AI at the Edge with Vinesh Sukumar - #623
Runway Gen-2: Generative AI for Video Creation with Anastasis Germanidis - #622
Watermarking Large Language Models to Fight Plagiarism with Tom Goldstein - 621
Does ChatGPT “Think”? A Cognitive Neuroscience Perspective with Anna Ivanova - #620
Robotic Dexterity and Collaboration with Monroe Kennedy III - #619
Privacy and Security for Stable Diffusion and LLMs with Nicholas Carlini - #618
Understanding AI’s Impact on Social Disparities with Vinodkumar Prabhakaran - #617
AI Trends 2023: Causality and the Impact on Large Language Models with Robert Osazuwa Ness - #616
Data-Centric Zero-Shot Learning for Precision Agriculture with Dimitris Zermas - #615
How LLMs and Generative AI are Revolutionizing AI for Science with Anima Anandkumar - #614
AI Trends 2023: Natural Language Proc - ChatGPT, GPT-4 and Cutting Edge Research with Sameer Singh - #613
AI Trends 2023: Reinforcement Learning - RLHF, Robotic Pre-Training, and Offline RL with Sergey Levine - #612
Supporting Food Security in Africa Using ML with Catherine Nakalembe - #611
Service Cards and ML Governance with Michael Kearns - #610
Reinforcement Learning for Personalization at Spotify with Tony Jebara - #609
Will ChatGPT take my job? - #608
Geospatial Machine Learning at AWS with Kumar Chellapilla - #607
Real-Time ML Workflows at Capital One with Disha Singla - #606
Weakly Supervised Causal Representation Learning with Johann Brehmer - #605
Create your
podcast in
minutes
It is Free
20/20
The Dropout
Ten Percent Happier with Dan Harris
World News Tonight with David Muir
NEJM This Week