Today we’re joined by James Zou, an assistant professor at Stanford University. In our conversation with James, we explore the differences in ChatGPT’s behavior over the last few months. We discuss the issues that can arise from inconsistencies in generative AI models, how he tested ChatGPT’s performance in various tasks, drawing comparisons between March 2023 and June 2023 for both GPT-3.5 and GPT-4 versions, and the possible reasons behind the declining performance of these models. James also shared his thoughts on how CRISPR could potentially revolutionize LLM and AI systems, and how adding monitoring tools can help in tracking behavioral changes in these models. Finally, we discuss James' recent paper on pathology image analysis using Twitter data, in which he explores the challenges of obtaining large medical datasets and data collection, as well as detailing the model’s architecture, training, and the evaluation process.
The complete show notes for this episode can be found at twimlai.com/go/645.
Real-Time ML Workflows at Capital One with Disha Singla - #606
Weakly Supervised Causal Representation Learning with Johann Brehmer - #605
Stable Diffusion & Generative AI with Emad Mostaque - #604
Exploring Large Language Models with ChatGPT - #603
Accelerating Intelligence with AI-Generating Algorithms with Jeff Clune - #602
Programmatic Labeling and Data Scaling for Autonomous Commercial Aviation with Cedric Cocaud - #601
Engineering Production NLP Systems at T-Mobile with Heather Nolis - #600
Sim2Real and Optimus, the Humanoid Robot with Ken Goldberg - #599
The Evolution of the NLP Landscape with Oren Etzioni - #598
Live from TWIMLcon! The Great MLOps Debate: End-to-End ML Platforms vs Specialized Tools - #597
Live from TWIMLcon! You're not Facebook. Architecting MLOps for B2B Use Cases with Jacopo Tagliabue - #596
Building Foundational ML Platforms with Kubernetes and Kubeflow with Ali Rodell - #595
AI-Powered Peer Programming with Vasi Philomin - #594
The Top 10 Reasons to Register for TWIMLcon: AI Platforms 2022!
Applied AI/ML Research at PayPal with Vidyut Naware - #593
Assessing Data Quality at Shopify with Wendy Foster - #592
Transformers for Tabular Data at Capital One with Bayan Bruss - #591
Understanding Collective Insect Communication with ML, w/ Orit Peleg - #590
Multimodal, Multi-Lingual NLP at Hugging Face with John Bohannon and Douwe Kiela - #589
Synthetic Data Generation for Robotics with Bill Vass - #588
Create your
podcast in
minutes
It is Free
20/20
The Dropout
Ten Percent Happier with Dan Harris
World News Tonight with David Muir
NEJM This Week