Evidence map›Paper›PMID 34593972›Full record

ArticleNPJ digital medicine2021

Statistical uncertainty quantification to augment clinical decision support: a first implementation in sleep medicine.

Dae Y Kang, Pamela N DeYoung, Justin Tantiongloc, Todd P Coleman, Robert L Owens

Abstract read
In one paragraph

Article in NPJ digital medicine, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Review
  2. Review
  3. Review
  4. Machine Learning Methods to Track Dynamic Facial Function in Facial Palsy.IEEE transactions on bio-medical engineering · 2025
    Article
  5. Article
  6. Review
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Dae Y KangDepartment of Medicine, Division of Pulmonary, Critical Care, & Sleep Medicine, University of California, San Diego, 9500 Gilman Dr, La Jolla, CA, 92093, USA.
Pamela N DeYoungDepartment of Medicine, Division of Pulmonary, Critical Care, & Sleep Medicine, University of California, San Diego, 9500 Gilman Dr, La Jolla, CA, 92093, USA.
Justin TantionglocDepartment of Computer Science & Engineering, University of California, San Diego, 9500 Gilman Dr, La Jolla, CA, 92093, USA.
Todd P ColemanDepartment of Bioengineering, University of California, San Diego, 9500 Gilman Dr, La Jolla, CA, 92093, USA.
Robert L OwensDepartment of Medicine, Division of Pulmonary, Critical Care, & Sleep Medicine, University of California, San Diego, 9500 Gilman Dr, La Jolla, CA, 92093, USA. rowens@health.ucsd.edu.ORCID http://orcid.org/0000-0002-6515-6204

Funding

Single Motor Unit Genioglossus Recordings to Understand Sleep Apnea PathogenesisR01HL085188 · NHLBI · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI MALHOTRA, ATUL · 2008 to 2018
$3.5M
NHLBI NIH HHS R01 HL085188U.S. Department of Health & Human Services | NIH | National Heart, Lung, and Blood Institute (NHLBI) R01HL085188
6 · The paper itself

Abstract

Machine learning has the potential to change the practice of medicine, particularly in areas that require pattern recognition (e.g. radiology). Although automated classification is unlikely to be perfect, few modern machine learning tools have the ability to assess their own classification confidence to recognize uncertainty that might need human review. Using automated single-channel sleep staging as a first implementation, we demonstrated that uncertainty information (as quantified using Shannon entropy) can be utilized in a "human in the loop" methodology to promote targeted review of uncertain sleep stage classifications on an epoch-by-epoch basis. Across 20 sleep studies, this feedback methodology proved capable of improving scoring agreement with the gold standard over automated scoring alone (average improvement in Cohen's Kappa of 0.28), in a fraction of the scoring time compared to full manual review (60% reduction). In summary, our uncertainty-based clinician-in-the-loop framework promotes the improvement of medical classification accuracy/confidence in a cost-effective and economically resourceful manner.

Identifiers

PMID34593972
PMCPMC8484290

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.