Invited lecture ·
Artificial intelligence in healthcare
A broad introduction to medical AI, from imaging and protein structure to multimodal models, wearables and fairness.
Cardiff Inspiring Research Student Congress · Cardiff, UK
Learning the shape of the data
- Delivered
- Event
- Cardiff Inspiring Research Student Congress
- Place
- Cardiff, UK
- Format
- Invited lecture
- Source deck
- 33 slides
From the slides
Deck notes
This student-congress lecture introduced artificial intelligence through concrete healthcare applications. It ranged from imaging and disease progression to protein structure, multimodal models and wearable measurements.
The question
Where is AI already changing healthcare, and what must be checked before those systems are trusted?
Deck outline
- What artificial intelligence means in healthcare
- Imaging patterns and disease progression
- Data-driven multiple sclerosis subtypes
- Protein structure and foundation models
- Multimodal medical models and wearable measures
- Algorithmic bias and unequal performance
Take-away
Medical AI is most convincing when it answers a defined clinical question and is evaluated across the people and settings it is intended to serve.
Original deck
Slide by slide
Read the 33-slide presentation in order, or use the index to jump.
Slide 01
Artificial Intelligence in Healthcare
Open full-size slide↗Arman Eshaghi, MD, PhD
NIHR Advanced Fellow
Queen Square Institute of Neurology
University College London
United Kingdom
Slide 02
Conflicts of interest
Open full-size slide↗- Received travel support from the National Multiple Sclerosis Society and honorarium from the Journal of Neurology, Neurosurgery and Psychiatry for Editorial Commentaries.
- Received research grants from Biogen, Merck and Roche. He acted as a member of advisory board meetings of Merck Serono and Bristol Myers Squibb.
- Founder and equity stake holder in Queen Square Analytics Limited.
- Serves on the editorial board of Neurology (American Academy of Neurology).
Slide 03
Outline
Open full-size slide↗Definition
Applications
Limits
Slide 04
Source: V7 Labs
Open full-size slide↗AI
Machine learning
Slide 05
Why AI in healthcare?
Open full-size slide↗Source: The Economist
Slide 06
Source: Wikipedia
Open full-size slide↗Slide 07
Slide 7
Open full-size slide↗Slide 08
Slide 8
Open full-size slide↗Applications
Slide 09
Sequences of atrophy progression and patient staging
Open full-size slide↗Disease classification
Symptom based
Symptom agnostic
Staging
Hampel et al, Nature Reviews Neurology, 2021
References
Slide 10
Data-driven MS types, Eshaghi et al, Nature Communication, 2021
Open full-size slide↗25%
32%
43%
References
Slide 11
Source: Huang et al, JAMA Network Open, 2023
Open full-size slide↗References
Slide 12
Source: Huang et al, JAMA Network Open, 2023
Open full-size slide↗References
Slide 13
Jumper et al, Nature, 2021
Open full-size slide↗Speaker notes+
showcases the remarkable capability of AlphaFold in predicting protein structures, illustrating a strong correlation between the accuracy of the protein's backbone structure and its side chains. This correlation is crucial because it demonstrates AlphaFold's effectiveness in predicting the complex and detailed three-dimensional shapes of proteins, which are essential for understanding their functions in biological systems.
References
Slide 14
Zhou et al, 2023, Nature
Open full-size slide↗References
Slide 15
Singhal et al, Nature, 2023
Open full-size slide↗USMLE Exam Results
Re-admission prediction
Singhal et al, preprint, expected 2024
Jiang et al, Nature, 2023
References
Slide 16
Moor et al, Nature, 2023
Open full-size slide↗References
Slide 17
Source: https://blog.research.google/2023/08/multimodal-medical-ai.html
Open full-size slide↗ELIXR: Multimodal AI
Xu et al, Under Review, expected 2024
Slide 18
Huang et al, Nature Medicine, 2023
Open full-size slide↗Speaker notes+
The article presents the development of PLIP, a multimodal artificial intelligence model that understands both images and text, trained on OpenPath, a large dataset of 208,414 pathology images paired with natural language descriptions. PLIP excels at classifying new pathology images across various datasets, achieving significant improvements in F1 scores compared to previous models. It also enhances pathology image retrieval from text inputs, showing substantial performance improvements across multiple datasets. One key performance metric of PLIP is its ability in zero-shot classification, where it achieves F1 scores ranging from 0.565 to 0.832 across four external validation datasets, outperforming the baseline CLIP model and demonstrating significant improvement in classifying pathology images.
References
Slide 19
The Dawn of LMMs: Preliminary Explorations with GPT-4Vision, 2023
Open full-size slide↗https://doi.org/10.48550/arXiv.2309.17421
References
Slide 20
Source: The Economist
Open full-size slide↗Slide 21
Slide 21
Open full-size slide↗Speaker notes+
In summary, this study introduces a novel method of using wearable technology and AI to track and predict the progression of Duchenne muscular dystrophy, offering significant improvements over current methods used in clinical trials and treatment development.
Slide 22
Ricotti et al, Nature Medicine, 2023
Open full-size slide↗Speaker notes+
6-Minute Walk Distance
References
Slide 23
Slide 23
Open full-size slide↗Slide 24
Yang et al, Nature Medicine, 2023
Open full-size slide↗References
Slide 25
Slide 25
Open full-size slide↗Slide 26
Han et al, Under Review, https://doi.org/10.1101/2023.09.12.23295381
Open full-size slide↗Randomized controlled trials for medical AI
Speaker notes+
The paper is a scoping review evaluating the current landscape of randomized controlled trials (RCTs) for artificial intelligence (AI) algorithms used in clinical practice. The authors conducted a systematic search for RCTs published between January 2018 - August 2023, resulting in 84 unique trials included in the analysis. The key findings were:
- Most trials were in gastroenterology (41.7%), radiology (15.5%), surgery (6%), and cardiology (6%).
- The US (31%) and China (28.6%) had the most trials, with most being single-center studies.
- 54.8% of trials had primary endpoints related to diagnostic accuracy. Other endpoints assessed care management, patient outcomes, and clinical decision making.
- 82.1% of trials reported positive results for their primary endpoint, suggesting AI’s potential to improve healthcare. However, publication bias is likely.
- Most models were deep learning systems for medical imaging, particularly video analysis. Models for structured data used various techniques like neural networks.
- Industry developed most models (56%), followed by academia (39.3%). Models were commonly evaluated in an assistive setup with clinicians.
Page 2: Key implications and limitations:
- Need for more multi-center and international trials to ensure generalizability of models across diverse populations and settings.
- Focus has been on technical performance, but impact on patient outcomes needs more assessment through endpoints like survival, symptoms, need for treatment.
- High reported success rate indicates promise of AI but is likely inflated by publication bias and lack of comprehensive, multi-center studies.
- Homogeneity of studies/models indicates immaturity of the field. More variety needed in research groups, interventions, outcomes assessed.
- Understanding of AI’s limitations requires focus on unsuccessful trials and models.
In conclusion, the review reveals expanding interest in clinical AI trials across many fields and geographies. While most find positive results, publication bias is likely. More comprehensive research is essential to fully understand AI’s impact and limitations in healthcare. Key gaps include multi-center trials, clinically meaningful endpoints, and unsuccessful models.
References
Slide 27
Yao et al, Nature Medicine, 2021
Open full-size slide↗Artificial intelligence–enabled electrocardiograms for identification of patients
with low ejection fraction: a pragmatic, randomized clinical trial
2.1%
1.6%
Diagnosis of low EF
References
Slide 28
Banerji et al, Nature Medicine, 2023
Open full-size slide↗References
Slide 29
Warnat-Herresthal et al, 2021, Nature
Open full-size slide↗References
Slide 30
Warnat-Herresthal, Nature, 2021
Open full-size slide↗Slide 31
Obermeyer et al, Science, 2019
Open full-size slide↗References
Slide 32
Summary
Open full-size slide↗AI Necessity
Applications
Lengthy path to translation
Risks
Slide 33
Slide 33
Open full-size slide↗Email: a.eshaghi@ucl.ac.uk