Evidence map›Paper›PMID 36397723›Full record

SynthesisActa obstetricia et gynecologica Scandinavica2023

Reporting and risk of bias of prediction models based on machine learning methods in preterm birth: A systematic review.

Qiuyu Yang, Xia Fan, Xiao Cao, Weijie Hao, Jiale Lu, Jia Wei, Jinhui Tian, Min Yin, Long Ge

Open access · diamondAbstract readSystematic Review
In one paragraph

Synthesis in Acta obstetricia et gynecologica Scandinavica, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed, 3 pooled it
3.9field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 3 syntheses or guidelines pooled it, 25 citations in OpenAlex.

  1. Pooled it
  2. Guideline
  3. Pooled it
  4. Article
  5. Review
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 3 institutions in 1 country.

Qiuyu YangEvidence-Based Nursing Center, School of Nursing, Lanzhou University, Lanzhou, China.
Xia FanDepartment of Obstetrics and Gynecology, The Second School of Clinical Medicine, Shanxi University of Chinese Medicine, Shanxi, China.
Xiao CaoEvidence-Based Nursing Center, School of Nursing, Lanzhou University, Lanzhou, China.
Weijie HaoEvidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, China.
Jiale LuEvidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, China.
Jia WeiEvidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, China.
Jinhui TianKey Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, China.
Min YinHealth Examination Center, The First Hospital of Lanzhou University, Lanzhou, China.ORCID 0000-0002-2435-6111
Long GeEvidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, China.ORCID 0000-0002-3555-1107
Lanzhou University · CNFirst Hospital of Lanzhou University · CNShanxi Medical University · CN

Funding

Gansu Provincial Science and Technology Plan Project 20CX9ZA112Gansu Provincial Science and Technology Plan Project 22JR5RA366
6 · The paper itself

Abstract

introductionThere was limited evidence on the quality of reporting and methodological quality of prediction models using machine learning methods in preterm birth. This systematic review aimed to assess the reporting quality and risk of bias of a machine learning-based prediction model in preterm birth. MATERIAL AND

methodsWe conducted a systematic review, searching the PubMed, Embase, the Cochrane Library, China National Knowledge Infrastructure, China Biology Medicine disk, VIP Database, and WanFang Data from inception to September 27, 2021. Studies that developed (validated) a prediction model using machine learning methods in preterm birth were included. We used the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement and Prediction model Risk of Bias Assessment Tool (PROBAST) to evaluate the reporting quality and the risk of bias of included studies, respectively. Findings were summarized using descriptive statistics and visual plots. The protocol was registered in PROSPERO (no. CRD 42022301623).

resultsTwenty-nine studies met the inclusion criteria, with 24 development-only studies and 5 development-with-validation studies. Overall, TRIPOD adherence per study ranged from 17% to 79%, with a median adherence of 49%. The reporting of title, abstract, blinding of predictors, sample size justification, explanation of model, and model performance were mostly poor, with TRIPOD adherence ranging from 4% to 17%. For all included studies, 79% had a high overall risk of bias, and 21% had an unclear overall risk of bias. The analysis domain was most commonly rated as high risk of bias in included studies, mainly as a result of small effective sample size, selection of predictors based on univariable analysis, and lack of calibration evaluation.

conclusionsReporting and methodological quality of machine learning-based prediction models in preterm birth were poor. It is urgent to improve the design, conduct, and reporting of such studies to boost the application of machine learning-based prediction models in preterm birth in clinical practice.

Indexed as

Premature BirthBiasChinaFemaleHumansInfant, NewbornMachine LearningPrognosisResearch Designmachine learningprediction modelpreterm birthquality of reportingrisk of biassystematic review

Identifiers

PMID36397723
PMCPMC9780725
OpenAlexW4309367682

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.