Evidence map›Paper›PMID 39167298›Full record

ArticleTherapeutic innovation & regulatory science2024

On the Application of Artificial Intelligence/Machine Learning (AI/ML) in Late-Stage Clinical Development.

Karl Köchert, Tim Friede, Michael Kunz, Herbert Pang, Yijie Zhou, Elena Rantou

Abstract read
PubMed Publisher
In one paragraph

Article in Therapeutic innovation & regulatory science, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Karl KöchertBayer AG, Berlin, Germany.
Tim FriedeDepartment of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany.
Michael KunzBayer AG, Berlin, Germany. michael.kunz@bayer.com.ORCID 0009-0001-5459-8867
Herbert PangGenentech, South San Francisco, CA, USA.
Yijie ZhouVertex Pharmaceuticals, Boston, MA, USA.
Elena RantouOffice of Biostatistics, FDA/CDER/OTS, Silver Spring, MD, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Whereas AI/ML methods were considered experimental tools in clinical development for some time, nowadays they are widely available. However, stakeholders in the health care industry still need to answer the question which role these methods can realistically play and what standards should be adhered to. Clinical research in late-stage clinical development has particular requirements in terms of robustness, transparency and traceability. These standards should also be adhered to when applying AI/ML methods. Currently there is some formal regulatory guidance available, but this is more directed at settings where a device or medical software is investigated. Here we focus on the application of AI/ML methods in late-stage clinical drug development, i.e. in a setting where currently less guidance is available. This is done via first summarizing available regulatory guidance and work done by regulatory statisticians followed by the presentation of an industry application where the influence of extensive sets of baseline characteristics on the treatment effect can be investigated by applying ML-methods in a standardized manner with intuitive graphical displays leveraging explainable AI methods. The paper aims at stimulating discussions on the role such analyses can play in general rather than advocating for a particular AI/ML-method or indication where such methods could be meaningful.

Indexed as

Artificial IntelligenceDrug DevelopmentMachine LearningHumansExploratory Data AnalysisMachine LearningPhase-III TrialRegulatory Decision Making

Identifiers

PMID39167298

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.