Evidence map›Paper›PMID 35156003›Full record

ReviewJAMIA open2022

Streamlining statistical reproducibility: NHLBI ORCHID clinical trial results reproduction.

Arnaud Serret-Larmande, Jonathan R Kaltman, Paul Avillach

Abstract readReview
In one paragraph

Review in JAMIA open, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Arnaud Serret-LarmandeDepartment of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA.ORCID https://orcid.org/0000-0002-2642-2514
Jonathan R KaltmanDivision of Cardiovascular Sciences, National Heart, Lung, and Blood Institute, NIH, Bethesda, Maryland, USA.
Paul AvillachDepartment of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA.ORCID https://orcid.org/0000-0002-0235-7543

Funding

The Integration of Trans-omics for Precision Medicine (TOPMED) and Other Heart, Lung, Blood and Sleep (HLBS) Data Sets with the Data CommonsOT3HL142481 · NHLBI · UNIVERSITY OF CALIFORNIA SANTA CRUZ · PI GROSSMAN, ROBERT L., PATEN, BENEDICT · 2017 to 2020
$24.9M
The Integration of Trans-omics for Precision Medicine (TOPMED) and Other Heart, Lung, Blood and Sleep (HLBS) Data Sets with the Data CommonsOT3HL142478 · NHLBI · SEVEN BRIDGES GENOMICS, INC. · PI DAVIS-DUSENBERY, BRANDI NICOLE · 2017 to 2022
$12.6M
The Integration of Trans-omics for Precision Medicine (TOPMED) and Other Heart, Lung, Blood and Sleep (HLBS) Data Sets with the Data CommonsOT3HL142480 · NHLBI · HARVARD MEDICAL SCHOOL · PI AVILLACH, PAUL · 2017 to 2022
$8.8M
The Integration of Trans-omics for Precision Medicine (TOPMED) and Other Heart, Lung, Blood and Sleep (HLBS) Data Sets with the Data CommonsOT3HL142479 · NHLBI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI KRISHNAMURTHY, ASHOK KUMAR · 2017 to 2020
$6.1M
NHLBI NIH HHS OT3 HL142478NHLBI NIH HHS OT3 HL142479NHLBI NIH HHS OT3 HL142480NHLBI NIH HHS OT3 HL142481
6 · The paper itself

Abstract

Reproducibility in medical research has been a long-standing issue. More recently, the COVID-19 pandemic has publicly underlined this fact as the retraction of several studies reached out to general media audiences. A significant number of these retractions occurred after in-depth scrutiny of the methodology and results by the scientific community. Consequently, these retractions have undermined confidence in the peer-review process, which is not considered sufficiently reliable to generate trust in the published results. This partly stems from opacity in published results, the practical implementation of the statistical analysis often remaining undisclosed. We present a workflow that uses a combination of informatics tools to foster statistical reproducibility: an open-source programming language, Jupyter Notebook, cloud-based data repository, and an application programming interface can streamline an analysis and help to kick-start new analyses. We illustrate this principle by (1) reproducing the results of the ORCHID clinical trial, which evaluated the efficacy of hydroxychloroquine in COVID-19 patients, and (2) expanding on the analyses conducted in the original trial by investigating the association of premedication with biological laboratory results. Such workflows will be encouraged for future publications from National Heart, Lung, and Blood Institute-funded studies.

Indexed as

clinical trialFAIR principlesstatistical reproducibility

Identifiers

PMID35156003
PMCPMC8826998

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.