Evidence map›Paper›PMID 34789534›Full record

SynthesisRMD open2021

Analysing and reporting of observational data: a systematic review informing the EULAR points to consider when analysing and reporting comparative effectiveness research with observational data in rheumatology.

Kim Lauper, Joanna Kedra, Maarten de Wit, Bruno Fautrel, Thomas Frisell, Kimme L Hyrich, Florenzo Iannone, Pedro M Machado, Lykke M Ørnbjerg, Ziga Rotar and 8 more

Abstract readSystematic Review
In one paragraph

Synthesis in RMD open, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

18 authors.

Kim LauperDivision of Rheumatology, Geneva University Hospitals & Faculty of Medicine, University of Geneva, Geneva, Switzerland Kim.lauper@hcuge.ch.ORCID 0000-0002-4315-9009
Joanna KedraInstitut Pierre Louis d'Epidémiologie et de Santé Publique (iPLESP), UMR S 1136, Sorbonne Universite, Paris, France.ORCID 0000-0003-3535-3183
Maarten de WitPatient Research Partner, EULAR, Zaltbommel, The Netherlands.ORCID 0000-0002-8428-6354
Bruno FautrelInstitut Pierre Louis d'Epidémiologie et de Santé Publique (iPLESP), UMR S 1136, Sorbonne Universite, Paris, France.ORCID 0000-0001-8845-4274
Thomas FrisellClinical Epidemiology Division, Department of Medicine (Solna), Karolinska Institutet, Stockholm, Sweden.
Kimme L HyrichCentre for Epidemiology Versus Arthritis, Manchester Academic Health Sciences Centre, The University of Manchester, Manchester, UK.
Florenzo Iannone8Department of Emergency and Organ Transplantation, Rheumatology Unit, University of of Bari, Bari, Italy.
Pedro M MachadoCentre for Rheumatology & Department of Neuromuscular Diseases, University College London, London, UK.ORCID 0000-0002-8411-7972
Lykke M ØrnbjergCopenhagen Center for Arthritis Research, Center for Rheumatology and Spine Diseases, Centre for Head and Orthopedics, Rigshospitalet, Glostrup, Denmark.ORCID 0000-0002-7832-6831
Ziga RotarBioRx.si, Department of Rheumatology, University Medical Centre Ljubljana & Faculty of Medicine, University of Ljubljana, Ljubljana, Slovenia.
Maria Jose SantosReuma.pt registry, Rheumatology Research Unit, Instituto de Medicina Molecular, Faculdade Medicina de Lisboa, Lisboa, Portugal.ORCID 0000-0002-7946-1365
Tanja A StammSection for Outcomes Research, Centre for Medical Statistics, Informatics and Complex Systems, Medical University of Vienna, Wien, Austria.ORCID 0000-0003-3073-7284
Simon R StonesEULAR patient research partner, Manchester, UK.
Anja StrangfeldProgramme area Epidemiology, Deutsches Rheuma-Forschungszentrum (DRFZ), Berlin, Germany.ORCID 0000-0002-6233-022X
Robert Bm LandewéClinical Immunology & Rheumatology, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.ORCID 0000-0002-0577-6620
Axel FinckhDivision of Rheumatology, Geneva University Hospitals & Faculty of Medicine, University of Geneva, Geneva, Switzerland.ORCID 0000-0002-1210-4347
Sytske Anne BergstraDepartment of Rheumatology, Leiden University Medical Center, Leiden, The Netherlands.ORCID 0000-0002-7136-5248
Delphine S CourvoisierDivision of Rheumatology, Geneva University Hospitals & Faculty of Medicine, University of Geneva, Geneva, Switzerland.ORCID 0000-0002-1956-2607

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesTo evaluate the analysis and reporting of comparative effectiveness research with observational data in rheumatology, informing European Alliance of Associations for Rheumatology points to consider.

methodsWe performed a systematic literature review searching Ovid MEDLINE for original articles comparing drug effectiveness in longitudinal observational studies, published in key rheumatology journals between 2008 and 2019. The extracted information focused on reporting and types of analyses. We evaluated if year of publication impacted results.

resultsFrom 9969 abstracts reviewed, 211 articles fulfilled the inclusion criteria. Ten per cent of studies did not adjust for confounding factors. Some studies did not explain how they chose covariates for adjustment (9%), used bivariate screening (21%) and/or stepwise selection procedures (18%). Only 33% studies reported the number of patients lost to follow-up and 25% acknowledged attrition (drop-out or treatment cessation). To account for attrition, studies used non-responder imputation, followed by last observation carried forward (LOCF) and complete case (CC) analyses. Most studies did not report the number of missing data on covariates (83%), and when addressed, 49% used CC and 11% LOCF. Date of publication did not influence the results.

conclusionMost studies did not acknowledge missing data and attrition, and a tenth did not adjust for any confounding factors. When attempting to account for them, several studies used methods which potentially increase bias (LOCF, CC analysis, bivariate screening…). This study shows that there is no improvement over the last decade, highlighting the need for recommendations for the assessment and reporting of comparative drug effectiveness in observational data in rheumatology.

Indexed as

RheumatologyBiasComparative Effectiveness ResearchHumansantirheumatic agentsarthritisepidemiology

Identifiers

PMID34789534
PMCPMC8601074

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.