Evidence map›Paper›PMID 30589219›Full record

ArticleResearch synthesis methods2019

Statistical properties of methods based on the Q-statistic for constructing a confidence interval for the between-study variance in meta-analysis.

Robbie C M van Aert, Marcel A L M van Assen, Wolfgang Viechtbauer

Abstract read
In one paragraph

Article in Research synthesis methods, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Article
  6. Article
  7. A systematic review and meta-analysis of anesthesia type on hip fracture post-surgery outcomes.OTA international : the open access journal of orthopaedic trauma · 2022
    Article
  8. Review
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Robbie C M van AertDepartment of Methodology and Statistics, Tilburg University, Tilburg, the Netherlands.ORCID https://orcid.org/0000-0001-6187-0665
Marcel A L M van AssenDepartment of Methodology and Statistics, Tilburg University, Tilburg, the Netherlands.
Wolfgang ViechtbauerDepartment of Psychiatry and Neuropsychology, Maastricht University, Maastricht, the Netherlands.ORCID https://orcid.org/0000-0003-3463-4063

Funding

Netherlands Organization for Scientific Research (NWO) 406-13-050
6 · The paper itself

Abstract

The effect sizes of studies included in a meta-analysis do often not share a common true effect size due to differences in for instance the design of the studies. Estimates of this so-called between-study variance are usually imprecise. Hence, reporting a confidence interval together with a point estimate of the amount of between-study variance facilitates interpretation of the meta-analytic results. Two methods that are recommended to be used for creating such a confidence interval are the Q-profile and generalized Q-statistic method that both make use of the Q-statistic. These methods are exact if the assumptions underlying the random-effects model hold, but these assumptions are usually violated in practice such that confidence intervals of the methods are approximate rather than exact confidence intervals. We illustrate by means of two Monte-Carlo simulation studies with odds ratio as effect size measure that coverage probabilities of both methods can be substantially below the nominal coverage rate in situations that are representative for meta-analyses in practice. We also show that these too low coverage probabilities are caused by violations of the assumptions of the random-effects model (ie, normal sampling distributions of the effect size measure and known sampling variances) and are especially prevalent if the sample sizes in the primary studies are small.

Indexed as

Confidence IntervalsMeta-Analysis as TopicModels, StatisticalStatistics as TopicComputer SimulationMonte Carlo MethodNormal DistributionOdds RatioProbabilityResearch DesignSample Sizeconfidence intervalsheterogeneitymeta-analysisrandom-effects model

Identifiers

PMID30589219
PMCPMC6590162

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.