Evidence map›Paper›PMID 23396282›Full record

ArticleNature methods2013

Critical assessment of automated flow cytometry data analysis techniques.

Nima Aghaeepour, Greg Finak, FlowCAP Consortium, DREAM Consortium, Holger Hoos, Tim R Mosmann, Ryan Brinkman, Raphael Gottardo, Richard H Scheuermann

Erratum issued Registry-linked trialAbstract read
In one paragraph

Article in Nature methods, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. It is linked to trial NCT04732000 (Oxidative Stress and Surgical Recovery), which is not on this map. Cited by 249 papers.

0numbers the graph read from it
0cells of the map it votes in
249citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04732000 phase2completednot on this mapstarted 2021, after this paper: background citation

Oxidative Stress and Surgical Recovery

TypeinterventionalSponsorStanford UniversityRan2021 to 2023Enrolled30ConditionsSurgical Recovery, Pain, PostoperativeArmsN-acetyl cysteine, Normal Saline
3 · Its place in the literature

Who cites it

249 citing papers in PubMed.

  1. Trial
  2. Trial
  3. Review
  4. AI In Leukemia Diagnostics: Complementing the Pathologist's Role.International journal of laboratory hematology · 2026
    Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Review
  13. Article
  14. Review
  15. Review
  16. Review
  17. Article
  18. Review
  19. Article
  20. Review

189 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

  • Erratum issued
5 · Who and what money

Authors and funding

9 authors.

Nima AghaeepourTerry Fox Laboratory, British Columbia Cancer Agency, Vancouver, British Columbia, Canada.
Greg Finak
FlowCAP Consortium
DREAM Consortium
Holger Hoos
Tim R Mosmann
Ryan Brinkman
Raphael Gottardo
Richard H Scheuermann

Funding

Tumor Evolution and Metastasis ProgramP30CA016672 · NCI · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI Fabien Delerue · 1985 to 2026
$290.8M
INTEGRATIVE IMMUNOLOGY TRAINING PROGRAMT32AI005284 · NIAID · UT SOUTHWESTERN MEDICAL CENTER · PI Nan Yan · 2003 to 2026
$7.4M
Gene Expression and Regulatory Networks in Human LeukocytesRC2GM093080 · NIGMS · HARVARD MEDICAL SCHOOL · PI BENOIST, CHRISTOPHE O., MATHIS, DIANE J · 2009 to 2010
$7.3M
The Statistical and Computational Analysis of Flow Cytometry DataR01EB008400 · NIBIB · FRED HUTCHINSON CANCER RESEARCH CENTER · PI GOTTARDO, RAPHAEL · 2008 to 2015
$2.9M
Exploring the consequences of the TNFRSF1A susceptibility allele for MSR01NS067305 · NINDS · BRIGHAM AND WOMEN'S HOSPITAL · PI DE JAGER, PHILIP L · 2009 to 2011
$1.2M
Identifying the cellular hierarchy and drug response of AML using cytometric dataR01CA163481 · NCI · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI QIU, PENG · 2012 to 2015
$1.1M
NCI NIH HHS R01 CA163481NIAID NIH HHS N01 AI040076NIAID NIH HHS T32 AI005284NIBIB NIH HHS R01 EB008400NIBIB NIH HHS R01EB008400NIGMS NIH HHS RC2 GM093080NIGMS NIH HHS RC2-GM093080NINDS NIH HHS R01 NS067305NINDS NIH HHS R01NS067305
6 · The paper itself

Abstract

Traditional methods for flow cytometry (FCM) data processing rely on subjective manual gating. Recently, several groups have developed computational methods for identifying cell populations in multidimensional FCM data. The Flow Cytometry: Critical Assessment of Population Identification Methods (FlowCAP) challenges were established to compare the performance of these methods on two tasks: (i) mammalian cell population identification, to determine whether automated algorithms can reproduce expert manual gating and (ii) sample classification, to determine whether analysis pipelines can identify characteristics that correlate with external variables (such as clinical outcome). This analysis presents the results of the first FlowCAP challenges. Several methods performed well as compared to manual gating or external variables using statistical performance measures, which suggests that automated methods have reached a sufficient level of maturity and accuracy for reliable use in FCM data analysis.

Indexed as

Computational BiologyImage Processing, Computer-AssistedAlgorithmsAnimalsCluster AnalysisData Interpretation, StatisticalFlow CytometryGraft vs Host DiseaseHumansLeukocytes, MononuclearLymphoma, Large B-Cell, DiffuseReproducibility of ResultsSensitivity and SpecificitySoftwareWest Nile Fever

Identifiers

PMID23396282
PMCPMC3906045

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-SA
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.