Today we’re joined by James Zou, an assistant professor at Stanford University. In our conversation with James, we explore the differences in ChatGPT’s behavior over the last few months. We discuss the issues that can arise from inconsistencies in generative AI models, how he tested ChatGPT’s performance in various tasks, drawing comparisons between March 2023 and June 2023 for both GPT-3.5 and GPT-4 versions, and the possible reasons behind the declining performance of these models. James also shared his thoughts on how CRISPR could potentially revolutionize LLM and AI systems, and how adding monitoring tools can help in tracking behavioral changes in these models. Finally, we discuss James' recent paper on pathology image analysis using Twitter data, in which he explores the challenges of obtaining large medical datasets and data collection, as well as detailing the model’s architecture, training, and the evaluation process.
The complete show notes for this episode can be found at twimlai.com/go/645.
Spatiotemporal Data Analysis with Rose Yu - #508
Parallelism and Acceleration for Large Language Models with Bryan Catanzaro - #507
Applying the Causal Roadmap to Optimal Dynamic Treatment Rules with Lina Montoya - #506
Constraint Active Search for Human-in-the-Loop Optimization with Gustavo Malkomes - #505
Fairness and Robustness in Federated Learning with Virginia Smith -#504
Scaling AI at H&M Group with Errol Koolmeister - #503
Evolving AI Systems Gracefully with Stefano Soatto - #502
ML Innovation in Healthcare with Suchi Saria - #501
Cross-Device AI Acceleration, Compilation & Execution with Jeff Gehlhaar - #500
The Future of Human-Machine Interaction with Dan Bohus and Siddhartha Sen - #499
Vector Quantization for NN Compression with Julieta Martinez - #498
Deep Unsupervised Learning for Climate Informatics with Claire Monteleoni - #497
Skip-Convolutions for Efficient Video Processing with Amir Habibian - #496
Advancing NLP with Project Debater w/ Noam Slonim - #495
Bringing AI Up to Speed with Autonomous Racing w/ Madhur Behl - #494
AI and Society: Past, Present and Future with Eric Horvitz - #493
Agile Applied AI Research with Parvez Ahammad - #492
Haptic Intelligence with Katherine J. Kuchenbecker - #491
Data Science on AWS with Chris Fregly and Antje Barth - #490
Accelerating Distributed AI Applications at Qualcomm with Ziad Asghar - #489
Create your
podcast in
minutes
It is Free
20/20
The Dropout
Ten Percent Happier with Dan Harris
World News Tonight with David Muir
NEJM This Week