Evidence map›Paper›PMID 36522637›Full record

ReviewBMC medical research methodology2022

Machine learning computational tools to assist the performance of systematic reviews: A mapping review.

Ramon Cierco Jimenez, Teresa Lee, Nicolás Rosillo, Reynalda Cordova, Ian A Cree, Angel Gonzalez, Blanca Iciar Indave Ruiz

Abstract readReview
In one paragraph

Review in BMC medical research methodology, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 33 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
33citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

33 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. [Applications, challenges and a trustworthy use of artificial intelligence in public health].Bundesgesundheitsblatt, Gesundheitsforschung, Gesundheitsschutz · 2025
    Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Ramon Cierco JimenezInternational Agency for Research on Cancer (IARC/WHO), Evidence Synthesis and Classification Branch, Lyon, France. ciercor@iarc.who.int.
Teresa LeeInternational Agency for Research on Cancer (IARC/WHO), Services to Science and Research Branch, Lyon, France.
Nicolás RosilloServicio de Medicina Preventiva, Hospital Universitario 12 de Octubre, Madrid, Spain.
Reynalda CordovaInternational Agency for Research on Cancer (IARC/WHO), Nutrition and Metabolism Branch, Lyon, France.
Ian A CreeInternational Agency for Research on Cancer (IARC/WHO), Evidence Synthesis and Classification Branch, Lyon, France.
Angel GonzalezLaboratori de Medicina Computacional, Unitat de Bioestadística, Facultat de Medicina, Universitat Autònoma de Barcelona, Bellaterra, Spain.
Blanca Iciar Indave RuizInternational Agency for Research on Cancer (IARC/WHO), Evidence Synthesis and Classification Branch, Lyon, France.

Funding

World Health Organization 001
6 · The paper itself

Abstract

backgroundWithin evidence-based practice (EBP), systematic reviews (SR) are considered the highest level of evidence in that they summarize the best available research and describe the progress in a determined field. Due its methodology, SR require significant time and resources to be performed; they also require repetitive steps that may introduce biases and human errors. Machine learning (ML) algorithms therefore present a promising alternative and a potential game changer to speed up and automate the SR process. This review aims to map the current availability of computational tools that use ML techniques to assist in the performance of SR, and to support authors in the selection of the right software for the performance of evidence synthesis.

methodsThe mapping review was based on comprehensive searches in electronic databases and software repositories to obtain relevant literature and records, followed by screening for eligibility based on titles, abstracts, and full text by two reviewers. The data extraction consisted of listing and extracting the name and basic characteristics of the included tools, for example a tool's applicability to the various SR stages, pricing options, open-source availability, and type of software. These tools were classified and graphically represented to facilitate the description of our findings.

resultsA total of 9653 studies and 585 records were obtained from the structured searches performed on selected bibliometric databases and software repositories respectively. After screening, a total of 119 descriptions from publications and records allowed us to identify 63 tools that assist the SR process using ML techniques.

conclusionsThis review provides a high-quality map of currently available ML software to assist the performance of SR. ML algorithms are arguably one of the best techniques at present for the automation of SR. The most promising tools were easily accessible and included a high number of user-friendly features permitting the automation of SR and other kinds of evidence synthesis reviews.

Indexed as

Machine LearningSoftwareAlgorithmsBibliometricsHumansSystematic Reviews as TopicAutomatizationEvidence-based practiceMachine learningMapping reviewSoftware developmentSystematic reviews

Identifiers

PMID36522637
PMCPMC9756658

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.