Evidence map›Paper›PMID 39120646›Full record

ArticleBriefings in bioinformatics2024

A comparison of scRNA-seq annotation methods based on experimentally labeled immune cell subtype dataset.

Qiqing Fu, Chenyu Dong, Yunhe Liu, Xiaoqiong Xia, Gang Liu, Fan Zhong, Lei Liu

Abstract readComparative Study
In one paragraph

Article in Briefings in bioinformatics, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Review
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Review
  11. Mapping Cell Identity from scRNA-seq: A primer on computational methods.Computational and structural biotechnology journal · 2025
    Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Qiqing FuInstitutes of Biomedical Sciences, Fudan University, 200032 Shanghai, P.R. China.
Chenyu DongInstitutes of Biomedical Sciences, Fudan University, 200032 Shanghai, P.R. China.
Yunhe LiuInstitutes of Biomedical Sciences, Fudan University, 200032 Shanghai, P.R. China.ORCID 0000-0002-2120-952X
Xiaoqiong XiaInstitutes of Biomedical Sciences, Fudan University, 200032 Shanghai, P.R. China.
Gang LiuInstitutes of Biomedical Sciences, Fudan University, 200032 Shanghai, P.R. China.
Fan ZhongIntelligent Medicine Institute, Fudan University, 200032 Shanghai, P.R. China.
Lei LiuIntelligent Medicine Institute, Fudan University, 200032 Shanghai, P.R. China.ORCID 0000-0002-9995-9080

Funding

Peak Disciplines
6 · The paper itself

Abstract

Cell-type annotation is a critical step in single-cell data analysis. With the development of numerous cell annotation methods, it is necessary to evaluate these methods to help researchers use them effectively. Reference datasets are essential for evaluation, but currently, the cell labels of reference datasets mainly come from computational methods, which may have computational biases and may not reflect the actual cell-type outcomes. This study first constructed an experimentally labeled immune cell-subtype single-cell dataset of the same batch and systematically evaluated 18 cell annotation methods. We assessed those methods under five scenarios, including intra-dataset validation, immune cell-subtype validation, unsupervised clustering, inter-dataset annotation, and unknown cell-type prediction. Accuracy and ARI were evaluation metrics. The results showed that SVM, scBERT, and scDeepSort were the best-performing supervised methods. Seurat was the best-performing unsupervised clustering method, but it couldn't fully fit the actual cell-type distribution. Our results indicated that experimentally labeled immune cell-subtype datasets revealed the deficiencies of unsupervised clustering methods and provided new dataset support for supervised methods.

Indexed as

Single-Cell AnalysisCluster AnalysisComputational BiologyHumansMolecular Sequence AnnotationRNA-SeqSingle-Cell Gene Expression Analysisbenchmarkcell-type annotationscRNA-seq

Identifiers

PMID39120646
PMCPMC11312369

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.