Evidence map›Paper›PMID 34473568›Full record

ArticleAmerican journal of speech-language pathology2021

Reliability and Accuracy of Expert Auditory-Perceptual Evaluation of Voice via Telepractice Platforms.

Kimberly L Dahl, Hasini R Weerathunge, Daniel P Buckley, Anton S Dolling, Manuel Díaz-Cádiz, Lauren F Tracy, Cara E Stepp

Abstract read
In one paragraph

Article in American journal of speech-language pathology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Article
  2. Article
  3. Acoustic Metrics of the Strain Dimension of Voice Quality: A Scoping Review.Journal of voice : official journal of the Voice Foundation · 2025
    Review
  4. Article
  5. Article
  6. Comparison of Voice Stimulability Testing in Telehealth and In-Person Formats.Journal of voice : official journal of the Voice Foundation · 2025
    Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Kimberly L DahlDepartment of Speech, Language and Hearing Sciences, Boston University, MA.ORCID 0000-0002-0525-8989
Hasini R WeerathungeDepartment of Speech, Language and Hearing Sciences, Boston University, MA.ORCID 0000-0002-0240-9104
Daniel P BuckleyDepartment of Speech, Language and Hearing Sciences, Boston University, MA.
Anton S DollingDepartment of Speech, Language and Hearing Sciences, Boston University, MA.
Manuel Díaz-CádizDepartment of Speech, Language and Hearing Sciences, Boston University, MA.
Lauren F TracyDepartment of Otolaryngology-Head & Neck Surgery, Boston, University School of Medicine, MA.ORCID 0000-0002-7680-4713
Cara E SteppDepartment of Speech, Language and Hearing Sciences, Boston University, MA.ORCID 0000-0002-8045-252X

Funding

Project-005UL1TR001430 · NCATS · BOSTON UNIVERSITY MEDICAL CAMPUS · PI BAIR-MERRITT, MEGAN H, CENTER, DAVID M. · 2015 to 2024
$52.3M
Advanced Research Training in Communication Sciences and DisordersT32DC013017 · NIDCD · BOSTON UNIVERSITY (CHARLES RIVER CAMPUS) · PI Cara E. Stepp · 2016 to 2026
$4.9M
Objective Measures for Clinical Assessment of Voice DisordersR01DC015570 · NIDCD · BOSTON UNIVERSITY (CHARLES RIVER CAMPUS) · PI STEPP, CARA E. · 2016 to 2025
$4.8M
NCATS NIH HHS UL1 TR001430NIDCD NIH HHS R01 DC015570NIDCD NIH HHS T32 DC013017
6 · The paper itself

Abstract

Purpose This study assessed the reliability and accuracy of auditory-perceptual voice evaluations by experienced clinicians via telepractice platforms. Method Voice samples from 20 individuals were recorded after transmission via telepractice platforms. Twenty experienced clinicians (10 speech-language pathologists, 10 laryngologists) evaluated the samples for dysphonia percepts (overall severity, roughness, breathiness, and strain) using a modified Consensus Auditory-Perceptual Evaluation of Voice. Reliability was calculated as the mean of squared differences between repeated ratings (intrarater agreement), and between individual and group mean ratings (interrater agreement). Repeated measures analyses of variance were constructed to measure effects of transmission condition (e.g., original recording, WebEx, Zoom), dysphonia percept, and their interaction on intrarater agreement, interrater agreement, and average ratings. Significant effects were evaluated with post hoc Tukey's tests. Results There were significant effects of transmission condition, percept, and their interaction on average ratings, and a significant effect of percept on interrater agreement. Post hoc testing revealed statistically, but not clinically, significant differences in average roughness ratings across transmission conditions, and significant differences in interrater agreement for several percepts. Overall severity had the highest agreement and strain had the lowest. Conclusion Telepractice transmission does not substantially reduce reliability or accuracy of auditory-perceptual voice evaluations by experienced clinicians.

Indexed as

DysphoniaVoiceHumansObserver VariationReproducibility of ResultsVoice Quality

Identifiers

PMID34473568
PMCPMC9132030

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.