Evidence map›Paper›PMID 23193203›Full record

ReviewBriefings in bioinformatics2013

Comparability and reproducibility of biomedical data.

Yunda Huang, Raphael Gottardo

Abstract readComparative StudyReview
In one paragraph

Review in Briefings in bioinformatics, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Review
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. AVOCADO: Visualization of Workflow-Derived Data Provenance for Reproducible Biomedical Research.Computer graphics forum : journal of the European Association for Computer Graphics · 2016
    Article
  14. Article
  15. Article
  16. FAST: FAST Analysis of Sequences Toolbox.Frontiers in genetics · 2015
    Article
  17. Review
  18. Relevance relations for the concept of reproducibility.Journal of the Royal Society, Interface · 2014
    Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors.

Yunda HuangFred Hutchinson Cancer Research Center, 1100 Fairview Avenue North, Mailstop M2-C200, Seattle, WA 98109-1024, USA.
Raphael Gottardo

Funding

SDMC: HIV Vaccine Trials NetworkUM1AI068635 · NIAID · FRED HUTCHINSON CANCER RESEARCH CENTER · PI Peter B. Gilbert, Yunda Huang · 2011 to 2026
$385.9M
Leadership for HIV/AIDS Clinical Trials Networks; HIV Vaccine Trials NetworkU01AI068635 · NIAID · FRED HUTCHINSON CANCER RESEARCH CENTER · PI SELF, STEVEN G. · 2006 to 2010
$53.8M
Immune signatures of protection induced by whole parasite malaria vaccinesU19AI089986 · NIAID · SEATTLE BIOMEDICAL RESEARCH INSTITUTE · PI MCELRATH, MARGARET JULIANA, STUART, KENNETH D · 2010 to 2015
$2.3M
NIAID NIH HHS U01 AI068635-01NIAID NIH HHS U19 AI089986-01NIAID NIH HHS UM1 AI068635
6 · The paper itself

Abstract

With the development of novel assay technologies, biomedical experiments and analyses have gone through substantial evolution. Today, a typical experiment can simultaneously measure hundreds to thousands of individual features (e.g. genes) in dozens of biological conditions, resulting in gigabytes of data that need to be processed and analyzed. Because of the multiple steps involved in the data generation and analysis and the lack of details provided, it can be difficult for independent researchers to try to reproduce a published study. With the recent outrage following the halt of a cancer clinical trial due to the lack of reproducibility of the published study, researchers are now facing heavy pressure to ensure that their results are reproducible. Despite the global demand, too many published studies remain non-reproducible mainly due to the lack of availability of experimental protocol, data and/or computer code. Scientific discovery is an iterative process, where a published study generates new knowledge and data, resulting in new follow-up studies or clinical trials based on these results. As such, it is important for the results of a study to be quickly confirmed or discarded to avoid wasting time and money on novel projects. The availability of high-quality, reproducible data will also lead to more powerful analyses (or meta-analyses) where multiple data sets are combined to generate new knowledge. In this article, we review some of the recent developments regarding biomedical reproducibility and comparability and discuss some of the areas where the overall field could be improved.

Indexed as

Biomedical ResearchComputational BiologyMeta-Analysis as TopicPeer Review, ResearchReproducibility of ResultsaccuracyAnalysis pipelineopen scienceprecisionprotocolstandardization

Identifiers

PMID23193203
PMCPMC3713713

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.