Evidence map›Paper›PMID 35659769›Full record

ArticleSystematic reviews2022

Major mistakes and errors in the use of Trial Sequential Analysis in systematic reviews or meta-analyses - protocol for a systematic review.

Christian Gunge Riberholt, Markus Harboe Olsen, Joachim Birch Milan, Christian Gluud

Abstract read
In one paragraph

Article in Systematic reviews, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Christian Gunge RiberholtDepartment of Neurorehabilitation, Traumatic Brain Injury, Copenhagen University Hospital - Rigshospitalet, Kettegård Alle 30, 2650, Hvidovre, Denmark. Christian.riberholt@regionh.dk.
Markus Harboe OlsenDepartment of Neuroanaesthesiology, Neuroscience Centre, Copenhagen University Hospital - Rigshospitalet, Blegdamsvej 9, 2100, Copenhagen, Denmark.
Joachim Birch MilanCopenhagen Trial Unit, Centre for Clinical Intervention Research, The Capital Region, Copenhagen University Hospital - Rigshospitalet, Blegdamsvej 9, 2100, Copenhagen, Denmark.
Christian GluudCopenhagen Trial Unit, Centre for Clinical Intervention Research, The Capital Region, Copenhagen University Hospital - Rigshospitalet, Blegdamsvej 9, 2100, Copenhagen, Denmark.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundAdequately conducted systematic reviews with meta-analyses are considered the highest level of evidence and thus directly defines many clinical guidelines. However, the risks of type I and II errors in meta-analyses are substantial. Trial Sequential Analysis is a method for controlling these risks. Erroneous use of the method might lead to research waste or misleading conclusions.

methodsThe current protocol describes a systematic review aimed to identify common and major mistakes and errors in the use of Trial Sequential Analysis by evaluating published systematic reviews and meta-analyses that include this method. We plan to include all studies using Trial Sequential Analysis published from January 2018 to January 2022, an estimated 400 to 600 publications. We will search Medical Literature Analysis and Retrieval System Online and the Cochrane Database of Systematic Reviews, including studies with all types of participants, interventions, and outcomes. Two independent reviewers will screen titles and abstracts, include relevant full text articles, extract data from the studies into a predefined checklist, and evaluate the methodological quality of the study using the AMSTAR 2, assessing the methodological quality of the systematic reviews. DISCUSSION: This protocol follows the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols (PRISMA-P). The identified mistakes and errors will be published in peer reviewed articles and form the basis of a reviewed guideline for the use of Trial Sequential Analysis. Appropriately controlling for type I and II errors might reduce research waste and improve quality and precision of the evidence that clinical guidelines are based upon.

Indexed as

ChecklistResearch DesignHumansMeta-Analysis as TopicSystematic Reviews as TopicMeta analysisMethodologySystematic reviewTrial Sequential Analysis

Identifiers

PMID35659769
PMCPMC9166392

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.