Evidence map›Paper›PMID 41180830›Full record

ArticleBMJ surgery, interventions, & health technologies2025

Development of a minimum checklist to assess the quality of evidence produced using registry data for the evaluation of medical device safety and performance.

Lotje A Hoogervorst, Rob G H H Nelissen, Tom Melvin, Paul Piscoi, Chris Wilkinson, Anne Lubbeke, Chris P Gale, David Epstein, Soren Overgaard, Phil Walmsley and 8 more

Abstract read
In one paragraph

Article in BMJ surgery, interventions, & health technologies, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

18 authors.

Lotje A HoogervorstDepartment of Orthopaedics, Leiden Universitair Medisch Centrum, Leiden, The Netherlands.ORCID https://orcid.org/0000-0001-5343-6965
Rob G H H NelissenDepartment of Orthopaedics, Leiden Universitair Medisch Centrum, Leiden, The Netherlands.ORCID https://orcid.org/0000-0003-1228-4162
Tom MelvinTrinity College Dublin School of Medicine, Dublin, Ireland.
Paul PiscoiDirectorate General for Health (DG SANTE), European Commission, Brussels, Belgium.
Chris WilkinsonAcademic Cardiovascular Unit, James Cook University Hospital, Middlesbrough, UK.
Anne LubbekeDivision of Orthopaedic Surgery and Traumatology, Geneva University Hospitals, Geneva, Switzerland.
Chris P GaleDepartment of Cardiology, Leeds Teaching Hospitals NHS Trust, Leeds, UK.
David EpsteinDepartment of Applied Economics, University of Granada, Granada, Spain.
Soren OvergaardDepartment of Orthopaedic Surgery and Traumatology, Copenhagen University Hospital, Copenhagen, Denmark.
Phil WalmsleySchool of Medicine, University of St Andrews, St Andrews, UK.
Piotr SzymanskiCentre for Postgraduate Medical Education, Warsaw, Poland.
Maziar MohaddesDepartment of Orthopaedics, University of Gothenburg Institute of Clinical Sciences, Gothenburg, Sweden.
Donal B O'ConnorHealth Products Regulatory Authority, Dublin, Ireland.
Robert E GeertsmaCentre for Health Protection, National Institute for Public Health and the Environment, Bilthoven, The Netherlands.ORCID https://orcid.org/0000-0003-0979-9077
Joëlle M HoebertCentre for Health Protection, National Institute for Public Health and the Environment, Bilthoven, The Netherlands.
Alan G FraserDepartment of Cardiology, University Hospital of Wales, Cardiff, UK.ORCID https://orcid.org/0000-0001-7083-6995
Perla J Marang-van de MheenSafety & Security Science and Centre for Safety in Healthcare, Delft University of Technology, Delft, The Netherlands.
CORE-MD study group

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Objectives: Medical device registries in Europe report limited information about their structure and methodological characteristics. This hinders their utility for evaluation of medical device safety and performance under the Medical Device Regulation. This study aimed to define a minimum checklist of items necessary for regulators to assess the quality of evidence produced using registry data for the evaluation of medical device safety and performance. Design: A three-round Delphi panel. Setting: A task within the Coordinating Research and Evidence for Medical Devices project. Participants: 101 experts in the medical device community (healthcare professionals, methodologists, registry experts, regulators, and assessors from notified bodies) were invited. Interventions: Based on a literature review and expert advice, 27 items relating to the quality of registry data and the analysis of medical device safety and performance were selected. In round 1, participants selected which items were required for a minimum checklist. They could also propose new items. Items selected by ≥70% of participants indicated consensus. Remaining items were discussed in round 2, resulting in a final checklist that was ranked by participants for importance (round 3). Main outcome measures: Consensus of items to be included in the minimum checklist. Results: 51 experts participated in round 1, achieving consensus on 18 (67%) items and suggesting 12 items. After discussion in round 2, 5 additional items were selected, resulting in a final set of 15 data quality items and 8 data analysis items. The most important items were 'completeness of procedures' (data quality) and 'definition of outcome analyzed'" (quality of analysis). Conclusions: Reporting all items from the minimum checklist will facilitate judgment of the utility of registry data to evaluate medical devices during post-market surveillance.

Indexed as

Cardiac DevicesDelphiDevicesDevice SurveillanceOrthopedic Devices

Identifiers

PMID41180830
PMCPMC12574368

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.