Evidence map›Paper›PMID 38319694›Full record

Observational studyJournal of medical Internet research2024

Limitations of the Cough Sound-Based COVID-19 Diagnosis Artificial Intelligence Model and its Future Direction: Longitudinal Observation Study.

Jina Kim, Yong Sung Choi, Young Joo Lee, Seung Geun Yeo, Kyung Won Kim, Min Seo Kim, Masoud Rahmati, Dong Keon Yon, Jinseok Lee

Abstract readObservational Study
In one paragraph

Observational study in Journal of medical Internet research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. The Effects of COVID-19 on Voice.World journal of otorhinolaryngology - head and neck surgery · 2025
    Review
  3. Article
  4. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Jina KimDepartment of Biomedical Engineering, Kyung Hee University, Seoul, Republic of Korea.ORCID 0009-0006-4661-7905
Yong Sung ChoiDepartment of Biomedical Engineering, Kyung Hee University, Seoul, Republic of Korea.ORCID 0000-0001-9181-7849
Young Joo LeeDepartment of Biomedical Engineering, Kyung Hee University, Seoul, Republic of Korea.ORCID 0000-0001-5294-7368
Seung Geun YeoDepartment of Biomedical Engineering, Kyung Hee University, Seoul, Republic of Korea.ORCID 0000-0001-8021-1024
Kyung Won KimDepartment of Radiology and Research Institute of Radiology, Asan Image Metrics, Clinical Trial Center, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea.ORCID 0000-0002-1532-5970
Min Seo KimMedical and Population Genetics and Cardiovascular Disease Initiative, Broad Institute of MIT and Harvard, Cambridge, MA, United States.ORCID 0000-0003-2115-7835
Masoud RahmatiDepartment of Physical Education and Sport Sciences, Faculty of Literature and Human Sciences, Lorestan University, Khoramabad, Iran.ORCID 0000-0003-4792-027X
Dong Keon Yon *Center for Digital Health, Medical Science Research Institute, Kyung Hee University Medical Center, Kyung Hee University College of Medicine, Seoul, Republic of Korea.ORCID 0000-0003-1628-9948
Jinseok Lee *Department of Biomedical Engineering, Kyung Hee University, Seoul, Republic of Korea.ORCID 0000-0002-8580-490X

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe outbreak of SARS-CoV-2 in 2019 has necessitated the rapid and accurate detection of COVID-19 to manage patients effectively and implement public health measures. Artificial intelligence (AI) models analyzing cough sounds have emerged as promising tools for large-scale screening and early identification of potential cases.

objectiveThis study aimed to investigate the efficacy of using cough sounds as a diagnostic tool for COVID-19, considering the unique acoustic features that differentiate positive and negative cases. We investigated whether an AI model trained on cough sound recordings from specific periods, especially the early stages of the COVID-19 pandemic, were applicable to the ongoing situation with persistent variants.

methodsWe used cough sound recordings from 3 data sets (Cambridge, Coswara, and Virufy) representing different stages of the pandemic and variants. Our AI model was trained using the Cambridge data set with subsequent evaluation against all data sets. The performance was analyzed based on the area under the receiver operating curve (AUC) across different data measurement periods and COVID-19 variants.

resultsThe AI model demonstrated a high AUC when tested with the Cambridge data set, indicative of its initial effectiveness. However, the performance varied significantly with other data sets, particularly in detecting later variants such as Delta and Omicron, with a marked decline in AUC observed for the latter. These results highlight the challenges in maintaining the efficacy of AI models against the backdrop of an evolving virus.

conclusionsWhile AI models analyzing cough sounds offer a promising noninvasive and rapid screening method for COVID-19, their effectiveness is challenged by the emergence of new virus variants. Ongoing research and adaptations in AI methodologies are crucial to address these limitations. The adaptability of AI models to evolve with the virus underscores their potential as a foundational technology for not only the current pandemic but also future outbreaks, contributing to a more agile and resilient global health infrastructure.

Indexed as

COVID-19Artificial IntelligenceCoughCOVID-19 TestingHumansPandemicsSARS-CoV-2AIAI modelartificial intelligencecoughcough soundCOVID-19COVID-19 variantsdevelopmentdiagnosishuman lifestyleSARS-CoV-2sound-basedsounds app

Identifiers

PMID38319694
PMCPMC10879967

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.