Evidence map›Paper›PMID 38831386›Full record

ArticleGenome biology2024

Systematic evaluation with practical guidelines for single-cell and spatially resolved transcriptomics data simulation under multiple scenarios.

Hongrui Duo, Yinghong Li, Yang Lan, Jingxin Tao, Qingxia Yang, Yingxue Xiao, Jing Sun, Lei Li, Xiner Nie, Xiaoxi Zhang and 4 more

Abstract readEvaluation Study
In one paragraph

Article in Genome biology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed.

  1. Article
  2. Review
  3. Review
  4. Review
  5. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Hongrui Duo *College of Life Sciences, Chongqing Normal University, Chongqing, 401331, People's Republic of China.
Yinghong Li *Chongqing Key Laboratory of Big Data for Bio Intelligence, Chongqing University of Posts and Telecommunications, Chongqing, 400065, People's Republic of China.
Yang Lan *Institute of Pathology and Southwest Cancer Center, Southwest Hospital, Army Medical University, Chongqing, 400038, People's Republic of China.
Jingxin TaoCollege of Life Sciences, Chongqing Normal University, Chongqing, 401331, People's Republic of China.
Qingxia YangZhejiang Provincial Key Laboratory of Precision Diagnosis and Therapy for Major Gynecological Diseases, Women's Hospital, Zhejiang University School of Medicine, Hangzhou, 310058, People's Republic of China.
Yingxue XiaoCollege of Life Sciences, Chongqing Normal University, Chongqing, 401331, People's Republic of China.
Jing SunCollege of Life Sciences, Chongqing Normal University, Chongqing, 401331, People's Republic of China.
Lei LiCollege of Life Sciences, Chongqing Normal University, Chongqing, 401331, People's Republic of China.
Xiner NieKey Laboratory of Biorheological Science and Technology, Ministry of Education, Bioengineering College, Chongqing University, Chongqing, 400044, People's Republic of China.
Xiaoxi ZhangCollege of Life Sciences, Chongqing Normal University, Chongqing, 401331, People's Republic of China.
Guizhao LiangKey Laboratory of Biorheological Science and Technology, Ministry of Education, Bioengineering College, Chongqing University, Chongqing, 400044, People's Republic of China.
Mingwei LiuKey Laboratory of Clinical Laboratory Diagnostics, College of Laboratory Medicine, Chongqing Medical University, Chongqing, 400016, People's Republic of China.
Youjin HaoCollege of Life Sciences, Chongqing Normal University, Chongqing, 401331, People's Republic of China. haoyoujin@hotmail.com.
Bo LiCollege of Life Sciences, Chongqing Normal University, Chongqing, 401331, People's Republic of China. libcell@cqnu.edu.cn.ORCID 0000-0001-9944-0003

Funding

China Postdoctoral Science Foundation 2021MD703942Graduate Research Innovation Project of Chongqing Normal University YKC23027National Natural Science Foundation of China 62101087Open Fund of Yunnan Key Laboratory of Plant Reproductive Adaptation and Evolutionary Ecology YNPRAEC-2023004Science and Technology Research Program of Chongqing Municipal Education Commission KJQN202100538
6 · The paper itself

Abstract

backgroundSingle-cell RNA sequencing (scRNA-seq) and spatially resolved transcriptomics (SRT) have led to groundbreaking advancements in life sciences. To develop bioinformatics tools for scRNA-seq and SRT data and perform unbiased benchmarks, data simulation has been widely adopted by providing explicit ground truth and generating customized datasets. However, the performance of simulation methods under multiple scenarios has not been comprehensively assessed, making it challenging to choose suitable methods without practical guidelines.

resultsWe systematically evaluated 49 simulation methods developed for scRNA-seq and/or SRT data in terms of accuracy, functionality, scalability, and usability using 152 reference datasets derived from 24 platforms. SRTsim, scDesign3, ZINB-WaVE, and scDesign2 have the best accuracy performance across various platforms. Unexpectedly, some methods tailored to scRNA-seq data have potential compatibility for simulating SRT data. Lun, SPARSim, and scDesign3-tree outperform other methods under corresponding simulation scenarios. Phenopath, Lun, Simple, and MFA yield high scalability scores but they cannot generate realistic simulated data. Users should consider the trade-offs between method accuracy and scalability (or functionality) when making decisions. Additionally, execution errors are mainly caused by failed parameter estimations and appearance of missing or infinite values in calculations. We provide practical guidelines for method selection, a standard pipeline Simpipe ( https://github.com/duohongrui/simpipe ; https://doi.org/10.5281/zenodo.11178409 ), and an online tool Simsite ( https://www.ciblab.net/software/simshiny/ ) for data simulation.

conclusionsNo method performs best on all criteria, thus a good-yet-not-the-best method is recommended if it solves problems effectively and reasonably. Our comprehensive work provides crucial insights for developers on modeling gene expression data and fosters the simulation process for users.

Indexed as

Gene Expression ProfilingSingle-Cell AnalysisComputational BiologyComputer SimulationHumansRNA-SeqSequence Analysis, RNASoftwareTranscriptomeData simulationEvaluationGuidelineSingle-cell transcriptomicsSpatially resolved transcriptomics

Identifiers

PMID38831386
PMCPMC11149245

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.