Evidence map›Paper›PMID 30361063›Full record

Trial reportEBioMedicine2018

Clinically validated machine learning algorithm for detecting residual diseases with multicolor flow cytometry analysis in acute myeloid leukemia and myelodysplastic syndrome.

Bor-Sheng Ko, Yu-Fen Wang, Jeng-Lin Li, Chi-Cheng Li, Pei-Fang Weng, Szu-Chun Hsu, Hsin-An Hou, Huai-Hsuan Huang, Ming Yao, Chien-Ting Lin and 9 more

Open access · goldAbstract readClinical TrialValidation Study
In one paragraph

Trial report in EBioMedicine, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 48 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
48citing papers in PubMed, 1 pooled it
5.6field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

48 citing papers in PubMed, 1 synthesis or guideline pooled it, 107 citations in OpenAlex.

  1. Pooled it
  2. Measurable Residual Disease.Methods in molecular biology (Clifton, N.J.) · 2027
    Article
  3. Review
  4. Article
  5. Article
  6. Review
  7. Review
  8. Review
  9. Review
  10. Article
  11. Review
  12. Review
  13. Review
  14. Review
  15. Review
  16. Article
  17. Review
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

19 authors at 3 institutions in 1 country.

Bor-Sheng KoDepartment of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan.
Yu-Fen WangTai-Cheng Stem Cell Therapy Center, National Taiwan University, Taipei, Taiwan.
Jeng-Lin LiDepartment of Electrical Engineering, National Tsing Hua University, Hsinchu, Taiwan.
Chi-Cheng LiTai-Cheng Stem Cell Therapy Center, National Taiwan University, Taipei, Taiwan; Center of Stem Cell and Precision Medicine, Buddhist Tzu Chi General Hospital, Hualien, Taiwan.
Pei-Fang WengTai-Cheng Stem Cell Therapy Center, National Taiwan University, Taipei, Taiwan.
Szu-Chun HsuDepartment of Laboratory Medicine, National Taiwan University Hospital, Taipei, Taiwan.
Hsin-An HouDepartment of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan.
Huai-Hsuan HuangDepartment of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan.
Ming YaoDepartment of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan.
Chien-Ting LinTai-Cheng Stem Cell Therapy Center, National Taiwan University, Taipei, Taiwan.
Jia-Hau LiuTai-Cheng Stem Cell Therapy Center, National Taiwan University, Taipei, Taiwan.
Cheng-Hong TsaiTai-Cheng Stem Cell Therapy Center, National Taiwan University, Taipei, Taiwan.
Tai-Chung HuangDepartment of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan.
Shang-Ju WuDepartment of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan.
Shang-Yi HuangDepartment of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan.
Wen-Chien ChouDepartment of Laboratory Medicine, National Taiwan University Hospital, Taipei, Taiwan.
Hwei-Fang TienDepartment of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan.
Chi-Chun LeeDepartment of Electrical Engineering, National Tsing Hua University, Hsinchu, Taiwan; Joint Research Center for AI Technology and All Vista Healthcare, Ministry of Science and Technology, Taiwan. Electronic address: cclee@ee.nthu.edu.tw.
Jih-Luh TangDepartment of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan; Tai-Cheng Stem Cell Therapy Center, National Taiwan University, Taipei, Taiwan. Electronic address: tangjh@ntu.edu.tw.
National Taiwan University Hospital · TWNational Taiwan University · TWNational Tsing Hua University · TW

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundMulticolor flow cytometry (MFC) analysis is widely used to identify minimal residual disease (MRD) after treatment for acute myeloid leukemia (AML) and myelodysplastic syndrome (MDS). However, current manual interpretation suffers from drawbacks of time consuming and interpreter idiosyncrasy. Artificial intelligence (AI), with the expertise in assisting repetitive or complex analysis, represents a potential solution for these drawbacks.

methodsFrom 2009 to 2016, 5333 MFC data from 1742 AML or MDS patients were collected. The 287 MFC data at post-induction were selected as the outcome set for clinical outcome validation. The rest were 4:1 randomized into the training set (n = 4039) and the validation set (n = 1007). AI algorithm learned a multi-dimensional MFC phenotype from the training set and input it to support vector machine (SVM) classifier after Gaussian mixture model (GMM) modeling, and the performance was evaluated in The validation set.

findingsPromising accuracies (84·6% to 92·4%) and AUCs (0·921-0·950) were achieved by the developed algorithms. Interestingly, the algorithm from even one testing tube achieved similar performance. The clinical significance was validated in the outcome set, and normal MFC interpreted by the AI predicted better progression-free survival (10·9 vs 4·9 months, p < 0·0001) and overall survival (13·6 vs 6·5 months, p < 0·0001) for AML.

interpretationThrough large-scaled clinical validation, we showed that AI algorithms can produce efficient and clinically-relevant MFC analysis. This approach also possesses a great advantage of the ability to integrate other clinical tests. FUND: This work was supported by the Ministry of Science and Technology (107-2634-F-007-006 and 103-2314-B-002-185-MY2) of Taiwan.

Indexed as

Flow CytometryMachine LearningDisease-Free SurvivalFemaleHumansLeukemia, Myeloid, AcuteMaleMyelodysplastic SyndromesNeoplasm, ResidualPredictive Value of TestsSurvival RateAcute myeloid leukemiaArtificial intelligenceMinimal residual diseaseMulticolor flow cytometryMyelodysplastic syndrome

Identifiers

PMID30361063
PMCPMC6284584
OpenAlexW2896930435

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.