Evidence map›Paper›PMID 31249430›Full record

ArticleJournal of the American Statistical Association2018

Maximum Rank Reproducibility: A Nonparametric Approach to Assessing Reproducibility in Replicate Experiments.

Daisy Philtron, Yafei Lyu, Qunhua Li, Debashis Ghosh

Abstract read
In one paragraph

Article in Journal of the American Statistical Association, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Daisy PhiltronDepartment of Statistics, Pennsylvania State University, PA.ORCID 0000-0002-1316-5555
Yafei LyuBioinformatics and Genomics Program, Pennsylvania State University, PA.
Qunhua LiDepartment of Statistics, Pennsylvania State University, PA.
Debashis GhoshDepartment of Biostatistics and Informatics, Colorado School of Public Health, Anschutz Medical Campus, CO.

Funding

Statistical methods for improving reproducibility and utility of sequencing dataR01GM109453 · NIGMS · PENNSYLVANIA STATE UNIVERSITY, THE · PI LI, QUNHUA · 2013 to 2022
$2.3M
NIGMS NIH HHS R01 GM109453
6 · The paper itself

Abstract

The identification of reproducible signals from the results of replicate high-throughput experiments is an important part of modern biological research. Often little is known about the dependence structure and the marginal distribution of the data, motivating the development of a nonparametric approach to assess reproducibility. The procedure, which we call the maximum rank reproducibility (MaRR) procedure, uses a maximum rank statistic to parse reproducible signals from noise without making assumptions about the distribution of reproducible signals. Because it uses the rank scale this procedure can be easily applied to a variety of data types. One application is to assess the reproducibility of RNA-seq technology using data produced by the sequencing quality control (SEQC) consortium, which coordinated a multi-laboratory effort to assess reproducibility across three RNA-seq platforms. Our results on simulations and SEQC data show that the MaRR procedure effectively controls false discovery rates, has desirable power properties, and compares well to existing methods. Supplementary materials for this article are available online.

Indexed as

AssociationFalse discovery rateGenomicsHigh-throughput experimentIrreproducible discovery rate

Identifiers

PMID31249430
PMCPMC6596287

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.