Evidence map›Paper›PMID 35643430›Full record

Observational studyBMC medical research methodology2022

Using observational study data as an external control group for a clinical trial: an empirical comparison of methods to account for longitudinal missing data.

Vibeke Norvang, Espen A Haavardsholm, Sara K Tedeschi, Houchen Lyu, Joseph Sexton, Maria D Mjaavatten, Tore K Kvien, Daniel H Solomon, Kazuki Yoshida

Abstract readObservational Study
In one paragraph

Observational study in BMC medical research methodology, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Vibeke NorvangDivision of Rheumatology and Research, Diakonhjemmet Hospital, Box 23 Vinderen, 0319, Oslo, Norway. v.norvang@gmail.com.
Espen A HaavardsholmDivision of Rheumatology and Research, Diakonhjemmet Hospital, Box 23 Vinderen, 0319, Oslo, Norway.
Sara K TedeschiDivision of Rheumatology, Inflammation, and Immunity, Department of Medicine, Brigham and Women's Hospital/Harvard Medical School, Boston, USA.
Houchen LyuDivision of Rheumatology, Inflammation, and Immunity, Department of Medicine, Brigham and Women's Hospital/Harvard Medical School, Boston, USA.
Joseph SextonDivision of Rheumatology and Research, Diakonhjemmet Hospital, Box 23 Vinderen, 0319, Oslo, Norway.
Maria D MjaavattenDivision of Rheumatology and Research, Diakonhjemmet Hospital, Box 23 Vinderen, 0319, Oslo, Norway.
Tore K KvienDivision of Rheumatology and Research, Diakonhjemmet Hospital, Box 23 Vinderen, 0319, Oslo, Norway.
Daniel H SolomonDivision of Rheumatology, Inflammation, and Immunity, Department of Medicine, Brigham and Women's Hospital/Harvard Medical School, Boston, USA.
Kazuki YoshidaDivision of Rheumatology, Inflammation, and Immunity, Department of Medicine, Brigham and Women's Hospital/Harvard Medical School, Boston, USA. kazukiyoshida@mail.harvard.edu.

Funding

Studying pseudogout using naturallanguage processing and novelimaging approachesK23AR075070 · NIAMS · BRIGHAM AND WOMEN'S HOSPITAL · PI TEDESCHI, SARA K. · 2019 to 2023
$937k
NIAMS NIH HHS K23 AR075070
6 · The paper itself

Abstract

backgroundObservational data are increasingly being used to conduct external comparisons to clinical trials. In this study, we empirically examined whether different methodological approaches to longitudinal missing data affected study conclusions in this setting.

methodsWe used data from one clinical trial and one prospective observational study, both Norwegian multicenter studies including patients with recently diagnosed rheumatoid arthritis and implementing similar treatment strategies, but with different stringency. A binary disease remission status was defined at 6, 12, and 24 months in both studies. After identifying patterns of longitudinal missing outcome data, we evaluated the following five approaches to handle missingness: analyses of patients with complete follow-up data, multiple imputation (MI), inverse probability of censoring weighting (IPCW), and two combinations of MI and IPCW.

resultsWe found a complex non-monotone missing data pattern in the observational study (N = 328), while missing data in the trial (N = 188) was monotone due to drop-out. In the observational study, only 39.0% of patients had complete outcome data, compared to 89.9% in the trial. All approaches to missing data indicated favorable outcomes of the treatment strategy in the trial and resulted in similar study conclusions. Variations in results across approaches were mainly due to variations in estimated outcomes for the observational data.

conclusionsFive different approaches to handle longitudinal missing data resulted in similar conclusions in our example. However, the extent and complexity of missing observational data affected estimated comparative outcomes across approaches, highlighting the need for careful consideration of methods to account for missingness in this setting. Based on this empirical examination, we recommend using a prespecified advanced missing data approach to account for longitudinal missing data, and to conduct alternative approaches in sensitivity analyses.

Indexed as

Models, StatisticalResearch DesignControl GroupsHumansProbabilityExternal control groupInverse probability weightingMissing dataMultiple imputation

Identifiers

PMID35643430
PMCPMC9148529

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.