Evidence map›Paper›PMID 28694878›Full record

ArticleStatistics in biosciences2017

ROC Curve Analysis in the Presence of Imperfect Reference Standards.

Peizhou Liao, Hao Wu, Tianwei Yu

Abstract read
In one paragraph

Article in Statistics in biosciences, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Chromatin accessibility of circulating CD8Nature communications · 2021
    Article
  5. Article
  6. Article
  7. Analysis of Risk Factors and the Establishment of a Predictive Model for Thrombosis in Patients with Immune Thrombocytopenia.Clinical and applied thrombosis/hemostasis : official journal of the International Academy of Clinical and Applied Thrombosis/Hemostasis
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Peizhou LiaoDepartment of Biostatistics and Bioinformatics, Emory University, Atlanta, Georgia 30322, Tel.: +1(404)747-8400, pliao3@emory.edu.
Hao WuDepartment of Biostatistics and Bioinformatics, Emory University, Atlanta, Georgia 30322, Tel.: +1(404)727-8633, , hao.wu@emory.edu.
Tianwei YuDepartment of Biostatistics and Bioinformatics, Emory University, Atlanta, Georgia 30322, Tel.: +1(404)727-7671, , tyu8@emory.edu.

Funding

Systems Biological Analysis of Innate and Adaptive Responses to VaccinationU19AI090023 · NIAID · EMORY UNIVERSITY · PI MULLIGAN, MARK JOSEPH · 2010 to 2021
$45.0M
Atlanta Clinical and Translational Science Institute (ACTSI) RenewalUL1TR000454 · NCATS · EMORY UNIVERSITY · PI STEPHENS, DAVID S · 2012 to 2016
$25.8M
Metabolomics of subclinical and clinical cardiovascular diseaseP20HL113451 · NHLBI · EMORY UNIVERSITY · PI JONES, DEAN PAUL · 2012 to 2016
$4.3M
Statistical Methods for Single-Cell RNA-SeqR01GM122083 · NIGMS · EMORY UNIVERSITY · PI WU, HAO · 2016 to 2020
$1.7M
Emory R38 Research Training ProgramR38AI140299 · NIAID · EMORY UNIVERSITY · PI OFOTOKUN, IGHOVWERHA, ROUPHAEL, NADINE GEORGES · 2018 to 2021
$1.4M
NCATS NIH HHS UL1 TR000454NHLBI NIH HHS P20 HL113451NIAID NIH HHS R38 AI140299NIAID NIH HHS U19 AI090023NIGMS NIH HHS R01 GM122083
6 · The paper itself

Abstract

The receiver operating characteristic (ROC) curve is an important tool for the evaluation and comparison of predictive models when the outcome is binary. If the class membership of the outcomes are known, ROC can be constructed for a model, and the ROC with greater area under the curve (AUC) indicates better performance. However in practice, imperfect reference standards often exist, in which class membership of every data point are not fully determined. This situation is especially prevalent in high-throughput biomedical data because obtaining perfect reference standards for all data points is either too costly or technically impractical. To construct ROC curves for these data, the common practice is to either ignore the uncertainties in references, or remove data points with high uncertainties. Such approaches may cause bias to the ROC curves and generate misleading results in method evaluation. Here we present a framework to incorporate membership uncertainties into the construction of ROC curve, termed the expected ROC or "eROC" curve. We develop an efficient procedure for the estimation of eROC curve. The advantages of using eROC are demonstrated using simulated and real data.

Indexed as

High-throughput DataImperfect Reference StandardsROC curve

Identifiers

PMID28694878
PMCPMC5501420

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.