Evidence map›Paper›PMID 37443337›Full record

ArticleNature methods2023

Large-scale benchmarking of circRNA detection tools reveals large differences in sensitivity but not in precision.

Marieke Vromman, Jasper Anckaert, Stefania Bortoluzzi, Alessia Buratin, Chia-Ying Chen, Qinjie Chu, Trees-Juen Chuang, Roozbeh Dehghannasiri, Christoph Dieterich, Xin Dong and 26 more

Erratum issuedAbstract read
In one paragraph

Article in Nature methods, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 76 papers.

0numbers the graph read from it
0cells of the map it votes in
76citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

76 citing papers in PubMed.

  1. Review
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Review
  11. Review
  12. Article
  13. Review
  14. Article
  15. Article
  16. Review
  17. Article
  18. Review
  19. Review
  20. Review

16 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

36 authors.

Marieke VrommanOncoRNALab, Cancer Research Institute Ghent (CRIG), Department of Biomolecular Medicine, Ghent University, Ghent, Belgium.ORCID http://orcid.org/0000-0002-0163-0675
Jasper AnckaertOncoRNALab, Cancer Research Institute Ghent (CRIG), Department of Biomolecular Medicine, Ghent University, Ghent, Belgium.ORCID http://orcid.org/0000-0001-8144-4639
Stefania BortoluzziDepartment of Molecular Medicine, University of Padova, Padova, Italy.
Alessia BuratinDepartment of Molecular Medicine, University of Padova, Padova, Italy.
Chia-Ying ChenGenomics Research Center, Academia Sinica, Taipei City, Taiwan.
Qinjie ChuInstitute of Crop Science and Institute of Bioinformatics, Zhejiang University, Zhejiang, China.
Trees-Juen ChuangGenomics Research Center, Academia Sinica, Taipei City, Taiwan.ORCID http://orcid.org/0000-0002-9661-6672
Roozbeh DehghannasiriDepartment of Biomedical Data Science and of Biochemistry, Stanford University, Stanford, CA, USA.ORCID http://orcid.org/0000-0001-7413-3437
Christoph DieterichKlaus Tschira Institute for Integrative Computational Cardiology, Department of Internal Medicine III, University Hospital Heidelberg, German Center for Cardiovascular Research (DZHK), Heidelberg, Germany.ORCID http://orcid.org/0000-0001-9468-6311
Xin DongSchool of Basic Medical Science, Department of Medical Genetics, Wuhan University, Wuhan, China.
Paul FlicekEMBL-EBI, Hinxton, UK.ORCID http://orcid.org/0000-0002-3897-7955
Enrico GaffoDepartment of Molecular Medicine, University of Padova, Padova, Italy.ORCID http://orcid.org/0000-0001-6338-7677
Wanjun GuCollaborative Innovation Center of Jiangsu Province of Cancer Prevention and Treatment of Chinese Medicine, School of Artificial Intelligence and Information Technology, Nanjing University of Chinese Medicine, Nanjing, China.
Chunjiang HeSchool of Basic Medical Science, Department of Medical Genetics, Wuhan University, Wuhan, China.ORCID http://orcid.org/0000-0002-4868-331X
Steve HoffmannComputational Biology Group, Leibniz Institute on Aging - Fritz Lipmann Institute (FLI), Jena, Germany.
Osagie IzuoguEMBL-EBI, Hinxton, UK.ORCID http://orcid.org/0000-0003-3116-2558
Michael S JacksonBiosciences Institute, Faculty of Medical Sciences, Newcastle University, Newcastle, UK.
Tobias JakobiTranslational Cardiovascular Research Center, University of Arizona - College of Medicine Phoenix, Phoenix, AZ, USA.ORCID http://orcid.org/0000-0002-3906-0401
Eric C LaiSloan Kettering Institute, New York, NY, USA.ORCID http://orcid.org/0000-0002-8432-5851
Justine NuytensOncoRNALab, Cancer Research Institute Ghent (CRIG), Department of Biomolecular Medicine, Ghent University, Ghent, Belgium.ORCID http://orcid.org/0000-0002-4878-1200
Julia SalzmanDepartment of Biomedical Data Science and of Biochemistry, Stanford University, Stanford, CA, USA.
Mauro Santibanez-KorefBiosciences Institute, Faculty of Medical Sciences, Newcastle University, Newcastle, UK.
Peter StadlerBioinformatics Group, Department of Computer Science, and Interdisciplinary Center for Bioinformatics, Universität Leipzig, Leipzig, Germany.ORCID http://orcid.org/0000-0002-5016-5191
Olivier ThasData Science Institute, I-Biostat, Hasselt University, Hasselt, Belgium.ORCID http://orcid.org/0000-0001-6442-4089
Eveline Vanden EyndeOncoRNALab, Cancer Research Institute Ghent (CRIG), Department of Biomolecular Medicine, Ghent University, Ghent, Belgium.ORCID http://orcid.org/0000-0003-0454-4171
Kimberly VerniersOncoRNALab, Cancer Research Institute Ghent (CRIG), Department of Biomolecular Medicine, Ghent University, Ghent, Belgium.
Guoxia WenState Key Laboratory of Bioelectronics, School of Biological Sciences and Medical Engineering, Southeast University, Nanjing, China.
Jakub WestholmDepartment of Biochemistry and Biophysics, National Bioinformatics Infrastructure Sweden, Science for Life Laboratory, Stockholm University, Stockholm, Sweden.ORCID http://orcid.org/0000-0002-6849-6220
Li YangCenter for Molecular Medicine, Children's Hospital, Fudan University and Shanghai Key Laboratory of Medical Epigenetics, International Laboratory of Medical Epigenetics and Metabolism, Ministry of Science and Technology, Institutes of Biomedical Sciences, Fudan University, Fudan, China.ORCID http://orcid.org/0000-0001-8833-7473
Chu-Yu YeInstitute of Crop Science and Institute of Bioinformatics, Zhejiang University, Zhejiang, China.ORCID http://orcid.org/0000-0003-0903-0356
Nurten YigitOncoRNALab, Cancer Research Institute Ghent (CRIG), Department of Biomolecular Medicine, Ghent University, Ghent, Belgium.ORCID http://orcid.org/0000-0003-1183-8688
Guo-Hua YuanCAS Key Laboratory of Computational Biology, Shanghai Institute of Nutrition and Health, University of Chinese Academy of Sciences, Chinese Academy of Sciences, Shanghai, China.ORCID http://orcid.org/0000-0002-8459-3784
Jinyang ZhangBeijing Institutes of Life Science, Chinese Academy of Sciences, Beijing, China.ORCID http://orcid.org/0000-0002-5163-894X
Fangqing ZhaoBeijing Institutes of Life Science, Chinese Academy of Sciences, Beijing, China.ORCID http://orcid.org/0000-0002-6216-1235
Jo VandesompeleOncoRNALab, Cancer Research Institute Ghent (CRIG), Department of Biomolecular Medicine, Ghent University, Ghent, Belgium. jo.vandesompele@ugent.be.ORCID http://orcid.org/0000-0001-6274-0184
Pieter-Jan VoldersOncoRNALab, Cancer Research Institute Ghent (CRIG), Department of Biomolecular Medicine, Ghent University, Ghent, Belgium.ORCID http://orcid.org/0000-0002-2685-2637

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Hongbiao Carl Lekaye · 1985 to 2026
$347.4M
Selective regulatory and biogenesis mechanisms for microRNAsR01GM083300 · NIGMS · SLOAN-KETTERING INST CAN RESEARCH · PI Eric C Lai · 2007 to 2026
$9.8M
Mechanism and regulation of Hu family RNA binding proteins during neural alternative polyadenylationR01NS083833 · NINDS · SLOAN-KETTERING INST CAN RESEARCH · PI LAI, ERIC C · 2014 to 2023
$5.4M
NCI NIH HHS P30 CA008748NIGMS NIH HHS R01 GM083300NIH HHS P30-CA008748NIH HHS R01-NS083833NINDS NIH HHS R01 NS083833Wellcome TrustWellcome Trust WT108749/Z/15/Z
6 · The paper itself

Abstract

The detection of circular RNA molecules (circRNAs) is typically based on short-read RNA sequencing data processed using computational tools. Numerous such tools have been developed, but a systematic comparison with orthogonal validation is missing. Here, we set up a circRNA detection tool benchmarking study, in which 16 tools detected more than 315,000 unique circRNAs in three deeply sequenced human cell types. Next, 1,516 predicted circRNAs were validated using three orthogonal methods. Generally, tool-specific precision is high and similar (median of 98.8%, 96.3% and 95.5% for qPCR, RNase R and amplicon sequencing, respectively) whereas the sensitivity and number of predicted circRNAs (ranging from 1,372 to 58,032) are the most significant differentiators. Of note, precision values are lower when evaluating low-abundance circRNAs. We also show that the tools can be used complementarily to increase detection sensitivity. Finally, we offer recommendations for future circRNA detection and validation.

Indexed as

BenchmarkingRNA, CircularHumansRNASequence Analysis, RNARNARNA, Circular

Identifiers

PMID37443337
PMCPMC10870000

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.