Evidence map›Paper›PMID 30610921›Full record

ArticleThe Journal of molecular diagnostics : JMD2019

A Rigorous Interlaboratory Examination of the Need to Confirm Next-Generation Sequencing-Detected Variants with an Orthogonal Method in Clinical Genetic Testing.

Stephen E Lincoln, Rebecca Truty, Chiao-Feng Lin, Justin M Zook, Joshua Paul, Vincent H Ramey, Marc Salit, Heidi L Rehm, Robert L Nussbaum, Matthew S Lebo

Abstract read
In one paragraph

Article in The Journal of molecular diagnostics : JMD, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 51 papers.

0numbers the graph read from it
0cells of the map it votes in
51citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

51 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Genetic analysis of neurodegenerative diseases.The Journal of clinical investigation · 2026
    Review
  5. Article
  6. Article
  7. Article
  8. Analysis ofCirculation. Genomic and precision medicine · 2025
    Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Heliyon · 2024
    Article
  17. Article
  18. Article
  19. Article
  20. Mutational analysis of theFrontiers in medicine · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Stephen E LincolnInvitae, San Francisco, California. Electronic address: steve.lincoln@invitae.com.
Rebecca TrutyInvitae, San Francisco, California.
Chiao-Feng LinLaboratory for Molecular Medicine, Partners HealthCare, Cambridge, Massachusetts; Department of Pathology, Brigham and Women's Hospital, Boston, Massachusetts.
Justin M ZookNational Institute of Standards and Technology, Gaithersburg, Maryland.
Joshua PaulInvitae, San Francisco, California.
Vincent H RameyInvitae, San Francisco, California.
Marc SalitNational Institute of Standards and Technology, Gaithersburg, Maryland; Joint Initiative for Metrology in Biology, Stanford, California.
Heidi L RehmLaboratory for Molecular Medicine, Partners HealthCare, Cambridge, Massachusetts; Department of Pathology, Brigham and Women's Hospital, Boston, Massachusetts; Center for Genomic Medicine, Massachusetts General Hospital, Boston, Massachusetts; Harvard Medical School, Boston, Massachusetts; Medical and Population Genetics, Broad Institute of MIT and Harvard, Cambridge, Massachusetts.
Robert L NussbaumInvitae, San Francisco, California; Department of Medicine, University of California San Francisco, San Francisco, California.
Matthew S LeboLaboratory for Molecular Medicine, Partners HealthCare, Cambridge, Massachusetts; Department of Pathology, Brigham and Women's Hospital, Boston, Massachusetts; Harvard Medical School, Boston, Massachusetts; Medical and Population Genetics, Broad Institute of MIT and Harvard, Cambridge, Massachusetts.

Funding

Integration of Whole Genome Sequencing into Clinical MedicineU01HG006500 · NHGRI · BRIGHAM AND WOMEN'S HOSPITAL · PI GREEN, ROBERT C. · 2012 to 2016
$11.5M
Global Alliance for Genomic Health (GA4GH)U01HG008676 · NHGRI · BRIGHAM AND WOMEN'S HOSPITAL · PI LENNON, NIALL JOHN, REHM, HEIDI L · 2015 to 2019
$8.6M
Genome Sequence-Based Screening for Childhood Risk and Newborn IllnessU19HD077671 · NICHD · BRIGHAM AND WOMEN'S HOSPITAL · PI BEGGS, ALAN H., GREEN, ROBERT C. · 2013 to 2018
$6.1M
Intramural NIST DOC 9999-NISTNHGRI NIH HHS U01 HG006500NHGRI NIH HHS U01 HG008676NICHD NIH HHS U19 HD077671
6 · The paper itself

Abstract

Orthogonal confirmation of next-generation sequencing (NGS)-detected germline variants is standard practice, although published studies have suggested that confirmation of the highest-quality calls may not always be necessary. The key question is how laboratories can establish criteria that consistently identify those NGS calls that require confirmation. Most prior studies addressing this question have had limitations: they have been generally of small scale, omitted statistical justification, and explored limited aspects of underlying data. The rigorous definition of criteria that separate high-accuracy NGS calls from those that may or may not be true remains a crucial issue. We analyzed five reference samples and over 80,000 patient specimens from two laboratories. Quality metrics were examined for approximately 200,000 NGS calls with orthogonal data, including 1662 false positives. A classification algorithm used these data to identify a battery of criteria that flag 100% of false positives as requiring confirmation (CI lower bound, 98.5% to 99.8%, depending on variant type) while minimizing the number of flagged true positives. These criteria identify false positives that the previously published criteria miss. Sampling analysis showed that smaller data sets resulted in less effective criteria. Our methodology for determining test- and laboratory-specific criteria can be generalized into a practical approach that can be used by laboratories to reduce the cost and time burdens of confirmation without affecting clinical accuracy.

Indexed as

AlgorithmsGenetic TestingGenetic VariationHigh-Throughput Nucleotide SequencingHumansSequence Analysis, DNA

Identifiers

PMID30610921
PMCPMC6629256

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.