Evidence map›Paper›PMID 37293884›Full record

SynthesisResearch synthesis methods2023

Effect estimates can be accurately calculated with data digitally extracted from interrupted time series graphs.

Simon Lee Turner, Elizabeth Korevaar, Miranda S Cumpston, Raju Kanukula, Andrew B Forbes, Joanne E McKenzie

Abstract readMeta-Analysis
In one paragraph

Synthesis in Research synthesis methods, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 7 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 7 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 7 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Trial
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Simon Lee TurnerSchool of Public Health and Preventive Medicine, Monash University, Melbourne, Australia.ORCID https://orcid.org/0000-0001-9163-4524
Elizabeth KorevaarSchool of Public Health and Preventive Medicine, Monash University, Melbourne, Australia.ORCID https://orcid.org/0000-0001-5808-7813
Miranda S CumpstonSchool of Public Health and Preventive Medicine, Monash University, Melbourne, Australia.ORCID https://orcid.org/0000-0001-6564-8615
Raju KanukulaSchool of Public Health and Preventive Medicine, Monash University, Melbourne, Australia.ORCID https://orcid.org/0000-0003-0793-786X
Andrew B ForbesSchool of Public Health and Preventive Medicine, Monash University, Melbourne, Australia.ORCID https://orcid.org/0000-0003-4269-914X
Joanne E McKenzieSchool of Public Health and Preventive Medicine, Monash University, Melbourne, Australia.ORCID https://orcid.org/0000-0003-3534-1641

Funding

Australian Government Research Training ProgramNational Health and Medical Research Council GNT2009612
6 · The paper itself

Abstract

Interrupted time series (ITS) studies are frequently used to examine the impact of population-level interventions or exposures. Systematic reviews with meta-analyses including ITS designs may inform public health and policy decision-making. Re-analysis of ITS may be required for inclusion in meta-analysis. While publications of ITS rarely provide raw data for re-analysis, graphs are often included, from which time series data can be digitally extracted. However, the accuracy of effect estimates calculated from data digitally extracted from ITS graphs is currently unknown. Forty-three ITS with available datasets and time series graphs were included. Time series data from each graph was extracted by four researchers using digital data extraction software. Data extraction errors were analysed. Segmented linear regression models were fitted to the extracted and provided datasets, from which estimates of immediate level and slope change (and associated statistics) were calculated and compared across the datasets. Although there were some data extraction errors of time points, primarily due to complications in the original graphs, they did not translate into important differences in estimates of interruption effects (and associated statistics). Using digital data extraction to obtain data from ITS graphs should be considered in reviews including ITS. Including these studies in meta-analyses, even with slight inaccuracy, is likely to outweigh the loss of information from non-inclusion.

Indexed as

Public HealthSoftwareInterrupted Time Series AnalysisTime Factorsdigital data extractioninterrupted time seriesmeta-analysispublic health

Identifiers

PMID37293884
PMCPMC10946754

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.