Evidence map›Paper›PMID 38536234›Full record

ArticleJMIR research protocols2024

Target Product Profile for a Machine Learning-Automated Retinal Imaging Analysis Software for Use in English Diabetic Eye Screening: Protocol for a Mixed Methods Study.

Trystan Macdonald, Jacqueline Dinnes, Gregory Maniatopoulos, Sian Taylor-Phillips, Bethany Shinkins, Jeffry Hogg, John Kevin Dunbar, Ameenat Lola Solebo, Hannah Sutton, John Attwood and 9 more

Open access · goldAbstract read
In one paragraph

Article in JMIR research protocols, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed, 1 pooled it
1.2field-weighted citation impact, top 23% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 1 synthesis or guideline pooled it, 3 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

19 authors at 12 institutions in 1 country.

Trystan MacdonaldOphthalmology Department, Queen Elizabeth Hospital Birmingham, University Hospitals Birmingham National Health Service Foundation Trust, Birmingham, United Kingdom.ORCID https://orcid.org/0000-0002-8561-0718
Jacqueline DinnesNational Institute for Health and Care Research Birmingham Biomedical Research Centre, Birmingham, United Kingdom.ORCID https://orcid.org/0000-0003-1343-7335
Gregory ManiatopoulosSchool of Business, University of Leicester, Leicester, United Kingdom.ORCID https://orcid.org/0000-0002-9602-3885
Sian Taylor-PhillipsWarwick Medical School, University of Warwick, Coventry, United Kingdom.ORCID https://orcid.org/0000-0002-1841-4346
Bethany ShinkinsWarwick Medical School, University of Warwick, Coventry, United Kingdom.ORCID https://orcid.org/0000-0001-5350-1018
Jeffry HoggPopulation Health Sciences Institute, Faculty of Medical Sciences, The University of Newcastle upon Tyne, Newcastle, United Kingdom.ORCID https://orcid.org/0000-0001-8044-7790
John Kevin DunbarNHS England, Leeds, United Kingdom.ORCID https://orcid.org/0000-0002-4562-5851
Ameenat Lola SoleboPopulation Policy and Practice, University College London Great Ormond Street Institute of Child Health, London, United Kingdom.ORCID https://orcid.org/0000-0002-8933-5864
Hannah SuttonLay member, Oxford, United Kingdom.ORCID https://orcid.org/0009-0006-1504-1296
John AttwoodAlder Hey Children's Hospital, Alder Hey Children's Hospital NHS Foundation Trust, Liverpool, United Kingdom.ORCID https://orcid.org/0009-0007-9111-2233
Michael PogoseHardian Health, London, United Kingdom.ORCID https://orcid.org/0000-0002-6095-1639
Rosalind Given-WilsonSt. George's University Hospitals National Health Service Foundation Trust, London, United Kingdom.ORCID https://orcid.org/0000-0002-0151-480X
Felix GreavesNational Institute for Health and Care Excellence, London, United Kingdom.ORCID https://orcid.org/0000-0001-9393-3122
Carl MacraeNottingham University Business School, University of Nottingham, Nottingham, United Kingdom.ORCID https://orcid.org/0000-0003-3198-7808
Russell PearsonMedicines and Healthcare Products Regulatory Agency, London, United Kingdom.ORCID https://orcid.org/0009-0003-9132-8633
Daniel BamfordNHS England, Leeds, United Kingdom.ORCID https://orcid.org/0009-0005-5628-5628
Adnan TufailMoorfields Eye Hospital NHS Foundation Trust, London, United Kingdom.ORCID https://orcid.org/0000-0001-6131-7640
Xiaoxuan Liu *Ophthalmology Department, Queen Elizabeth Hospital Birmingham, University Hospitals Birmingham National Health Service Foundation Trust, Birmingham, United Kingdom.ORCID https://orcid.org/0000-0002-1286-0038
Alastair K Denniston *Ophthalmology Department, Queen Elizabeth Hospital Birmingham, University Hospitals Birmingham National Health Service Foundation Trust, Birmingham, United Kingdom.ORCID https://orcid.org/0000-0001-7849-0087
National Health Service · GBMoorfields Eye Hospital NHS Foundation Trust · GBNHS Digital · GBUniversity of Warwick · GBBausch Health (United Kingdom) · GBNational Institute for Health and Care Excellence · GBNewcastle University · GBNIHR Birmingham Biomedical Research Centre · GBScience Oxford · GBUniversity of Leicester · GBUniversity of Liverpool · GBUniversity of Nottingham · GB

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundDiabetic eye screening (DES) represents a significant opportunity for the application of machine learning (ML) technologies, which may improve clinical and service outcomes. However, successful integration of ML into DES requires careful product development, evaluation, and implementation. Target product profiles (TPPs) summarize the requirements necessary for successful implementation so these can guide product development and evaluation.

objectiveThis study aims to produce a TPP for an ML-automated retinal imaging analysis software (ML-ARIAS) system for use in DES in England.

methodsThis work will consist of 3 phases. Phase 1 will establish the characteristics to be addressed in the TPP. A list of candidate characteristics will be generated from the following sources: an overview of systematic reviews of diagnostic test TPPs; a systematic review of digital health TPPs; and the National Institute for Health and Care Excellence's Evidence Standards Framework for Digital Health Technologies. The list of characteristics will be refined and validated by a study advisory group (SAG) made up of representatives from key stakeholders in DES. This includes people with diabetes; health care professionals; health care managers and leaders; and regulators and policy makers. In phase 2, specifications for these characteristics will be drafted following a series of semistructured interviews with participants from these stakeholder groups. Data collected from these interviews will be analyzed using the shortlist of characteristics as a framework, after which specifications will be drafted to create a draft TPP. Following approval by the SAG, in phase 3, the draft will enter an internet-based Delphi consensus study with participants sought from the groups previously identified, as well as ML-ARIAS developers, to ensure feasibility. Participants will be invited to score characteristic and specification pairs on a scale from "definitely exclude" to "definitely include," and suggest edits. The document will be iterated between rounds based on participants' feedback. Feedback on the draft document will be sought from a group of ML-ARIAS developers before its final contents are agreed upon in an in-person consensus meeting. At this meeting, representatives from the stakeholder groups previously identified (minus ML-ARIAS developers, to avoid bias) will be presented with the Delphi results and feedback of the user group and asked to agree on the final contents by vote.

resultsPhase 1 was completed in November 2023. Phase 2 is underway and expected to finish in March 2024. Phase 3 is expected to be complete in July 2024.

conclusionsThe multistakeholder development of a TPP for an ML-ARIAS for use in DES in England will help developers produce tools that serve the needs of patients, health care providers, and their staff. The TPP development process will also provide methods and a template to produce similar documents in other disease areas. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/50568.

Indexed as

artificial intelligencedesigndevelopersdiabetes mellitusdiabeticdiabetic eye screeningdiabetic retinopathyDMEnglandeye screeningimaging analysis softwareimplementationmachine learningretinal imagingstudy protocoltarget product profile

Identifiers

PMID38536234
PMCPMC11007610
OpenAlexW4391793376

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.