Evidence map›Paper›PMID 36914815›Full record

ArticleScientific reports2023

Benchmarking machine learning robustness in Covid-19 genome sequence classification.

Sarwan Ali, Bikram Sahoo, Alexander Zelikovsky, Pin-Yu Chen, Murray Patterson

Open access · goldFull text read
In one paragraph

Article in Scientific reports, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
3.8field-weighted citation impact, top 6% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 26 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 2 institutions in 1 country.

Sarwan AliDepartment of Computer Science, Georgia State University, Atlanta, GA, USA. sali85@student.gsu.edu.
Bikram SahooDepartment of Computer Science, Georgia State University, Atlanta, GA, USA.
Alexander ZelikovskyDepartment of Computer Science, Georgia State University, Atlanta, GA, USA.
Pin-Yu ChenIBM T. J. Watson Research Center, Yorktown Heights, Yorktown, NY, USA.
Murray PattersonDepartment of Computer Science, Georgia State University, Atlanta, GA, USA.
Georgia State University · USIBM Research - Thomas J. Watson Research Center · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

The rapid spread of the COVID-19 pandemic has resulted in an unprecedented amount of sequence data of the SARS-CoV-2 genome-millions of sequences and counting. This amount of data, while being orders of magnitude beyond the capacity of traditional approaches to understanding the diversity, dynamics, and evolution of viruses, is nonetheless a rich resource for machine learning (ML) approaches as alternatives for extracting such important information from these data. It is of hence utmost importance to design a framework for testing and benchmarking the robustness of these ML models. This paper makes the first effort (to our knowledge) to benchmark the robustness of ML models by simulating biological sequences with errors. In this paper, we introduce several ways to perturb SARS-CoV-2 genome sequences to mimic the error profiles of common sequencing platforms such as Illumina and PacBio. We show from experiments on a wide array of ML models that some simulation-based approaches with different perturbation budgets are more robust (and accurate) than others for specific embedding methods to certain noise simulations on the input sequences. Our benchmarking framework may assist researchers in properly assessing different ML models and help them understand the behavior of the SARS-CoV-2 virus or avoid possible future pandemics.

Indexed as

Computer SimulationGenome, ViralMachine LearningResearch DesignSARS-CoV-2COVID-19Sequence Analysis, RNAViral ProteinsViral Proteins

Identifiers

PMID36914815
PMCPMC10010240
OpenAlexW4324128859

What OpenQuestion holds

Textfull text, public
LicenceCC BY
reference markers read2
measurements read8
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.