This is the fourth part in a series on artificial intelligence in medicine and we try and unpick the causes and consequences of adverse events resulting from this technology. Our guest David Lyell is a research fellow at the Australian Institute of Health Innovation (Macquarie University) who has published a first-of-its kind audit of adverse events reported to the US regulator, the Federal Drugs Administration. He breaks down those that were caused by errors in the machine learning algorithm, other aspects of a device or even user error.
We also discuss where these all fit in to the four stages of human information processing, and whether this can inform determinations about liability. Uncertainty around the medicolegal aspects of AI-assisted care is of the main reasons that practitioners report discomfort about the use of this technology. It's a question that hasn’t been well tested yet in the courts, though according to academic lawyer Rita Matulonyte, AI-enhanced devices don’t change the scope of care that has been expected of practitioners in the past.
Guests
>Rita Matuolynte PhD (Macquarie Law School, Macquarie University; ARC Centre of Excellence for Automated Decision Making and Society; MQ Research Centre for Agency, Values and Ethics)
>David Lyell PhD (Australian Institute of Health Innovation, Macquarie University; owner Future Echoes Business Solutions)
Production
Produced by Mic Cavazzini DPhil. Music licenced from Epidemic Sound includes ‘Kryptonite’ by Blue Steel and ‘Illusory Motion’ by Gavin Luke. Music courtesy of Free Music Archive includes ‘Impulsing’ by Borrtex. Image by EMS-Forster-Productions licenced from Getty Images.
Editorial feedback kindly provided by physicians David Arroyo, Stephen Bacchi, Aidan Tan, Ronaldo Piovezan and Rahul Barmanray and RACP staff Natasa Lazarevic PhD.
Key References
More than algorithms: an analysis of safety events involving ML-enabled medical devices reported to the FDA [Lyell, J Am Med Inform Assoc. 2023]
How machine learning is embedded to support clinician decision making: an analysis of FDA-approved medical devices [Lyell, BMJ Health Care Inform. 2021]
Should AI-enabled medical devices be explainable? [Matulonyte, Int J Law Inform Tech. 2022]
Please visit the Pomegranate Health web page for a transcript and supporting references. Login to MyCPD to record listening and reading as a prefilled learning activity. Subscribe to new episode email alerts or search for ‘Pomegranate Health’ in Apple Podcasts, Spotify, Castbox or any podcasting app.
[Case Report] 68yo with cardiometabolic risk factors and transient monocular vision loss
[Journal Club] Baricitinib immune therapy for new onset type 1 diabetes
Ep106: The whiskey fix and the apple of Granada
Ep105: When parents and paediatrics clash
[IMJ On-Air] Is the jury still out on omega-3 supplementation?
[IMJ On-Air] HepatoCare: a model for palliative and supportive care in advanced cirrhosis
Ep102: Staying on script with semaglutide
Ep101: Setting the standard for workforce wellbeing
Ep100: Conversations with ChatGPT
[IMJ On-Air] A tiger in the mallee: Victoria’s JEV cluster
Ep97: The governance of AI
Ep96: The ergonomics of AI
Ep95: Machine Learning 101
Ep94: Facing up to racial bias
Ep93: The rise and fall of mpox
Ep92: Data-driven practice improvement
[IMJ On-Air] Hyperglycaemia and COVID-19
[IMJ On-Air] High readmission rates in cirrhotic patients
Ep89: What we know about long COVID
Create your
podcast in
minutes
It is Free
The Relaxback UK Show
Good Nurse Bad Nurse
On Call With Dr. Anselm Anyoha
The Doctor’s Farmacy with Mark Hyman, M.D.
The Peter Attia Drive