ArticleCancers2021
An Extensive Quality Control and Quality Assurance (QC/QA) Program Significantly Improves Inter-Laboratory Concordance Rates of Flow-Cytometric Minimal Residual Disease Assessment in Acute Lymphoblastic Leukemia: An I-BFM-FLOW-Network Report.
Abstract read
In one paragraph
Article in Cancers, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers.
0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed
–field-weighted citation impact
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
16 citing papers in PubMed.
- Disease characteristics and outcomes of Croatian pediatric patients with acute lymphoblastic leukemia: pretreatment immunophenotypic predictors of high bone marrow minimal residual disease on day 15 of treatment.Croatian medical journal · 2025Trial
- Accurate automated diagnosis of B-acute lymphoblastic leukemia using deep learning and flow cytometry.Haematologica · 2026Article
- Article
- Prospective use of molecular minimal residual disease for risk stratification in children and adolescents with acute lymphoblastic leukemia : Long-term results of the AIEOP-BFM ALL 2000 trial in Austria.Wiener klinische Wochenschrift · 2024Article
- Genetic alterations in lymphoblastic leukaemiaMedizinische Genetik : Mitteilungsblatt des Berufsverbandes Medizinische Genetik e.V · 2024Article
- Flow cytometric minimal residual disease measurement accounting for cytogenetics in children with non-high-risk acute lymphoblastic leukemia treated according to the ALL-MB 2008 protocol.Cancer medicine · 2024Article
- Article
- One-point flow cytometric MRD measurement to identify children with excellent outcome after intermediate-risk BCP-ALL: results of the ALL-MB 2008 study.Journal of cancer research and clinical oncology · 2023Article
- Measurable Residual Disease and Fusion Partner Independently Predict Survival and Relapse Risk in ChildhoodJournal of clinical oncology : official journal of the American Society of Clinical Oncology · 2023Article
- Combined ultrasonography and CT for prognosis and predicting clinical outcomes of patients with pseudomyxoma peritonei.European radiology · 2023Article
- Outcomes of Childhood Noninfant Acute Lymphoblastic Leukemia With 11q23/Journal of clinical oncology : official journal of the American Society of Clinical Oncology · 2023Article
- Multicentric standardization of minimal/measurable residual disease in B-cell precursor acute lymphoblastic leukaemia using next-generation flow cytometry in a low/middle-level income country.British journal of haematology · 2023Article
- Immunophenotypic measurable residual disease monitoring in adult acute lymphoblastic leukemia patients undergoing allogeneic hematopoietic stem cell transplantation.Frontiers in oncology · 2023Review
- Article
- MRD Monitoring by Multiparametric Flow Cytometry in AML: Is It Time to Incorporate Immune Parameters?Cancers · 2022Review
- Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
70 authors.
Margarita Maurer-GranofszkyChildren's Cancer Research Institute, Medical University of Vienna, 1090 Vienna, Austria.ORCID 0000-0003-3519-9972
Angela SchumichChildren's Cancer Research Institute, Medical University of Vienna, 1090 Vienna, Austria.
Barbara BuldiniPediatric Hematology, Oncology and Stem Cell Transplant Division, Maternal and Child Health Department, University of Padova, 35122 Padova, Italy.
Giuseppe GaipaM. Tettamanti Foundation Research Center, Department of Pediatrics, University of Milano-Bicocca, 20900 Monza, Italy.ORCID 0000-0002-1006-5946
Janos KappelmayerDepartment of Laboratory Medicine, University of Debrecen, 4032 Debrecen, Hungary.
Ester MejstrikovaDepartment of Paediatric Haematology and Oncology, University Hospital Motol, 150 06 Prague, Czech Republic.
Leonid KarawajewDepartment of Pediatric Oncology and Hematology, Charité Berlin, 10117 Berlin, Germany.
Jorge RossiCellular Immunology Laboratory, Hospital de Pediatria "Dr. Juan P. Garrahan", Buenos Aires C1245, Argentina.
Adın Çınar SuzanDepartment of Immunology, Aziz Sancar Institute of Experimental Medicine, Istanbul University, 34452 Istanbul, Turkey.
Evangelina AgrielloLEB Laboratorio, Servicio de Hematologia Hospital Penna, Bahia Blanca B8000, Argentina.
Theodora Anastasiou-GrenzeliaP.&A. Kyriakou Children's Hospital of Athens, 115 27 Athens, Greece.
Virna BarcalaLaboratory-Flow Cytometry, Citomlab, Buenos Aires C1406AWK, Argentina.
Gábor Barna1st Department of Pathology and Experimental Cancer Research, Semmelweis University, 1085 Budapest, Hungary.ORCID 0000-0002-8895-3062
Drago BatinićDivision of Laboratory Immunology, Department of Laboratory Diagnostics, University Hospital Centre Zagreb & School of Medicine, 10000 Zagreb, Croatia.
Jean-Pierre BourquinDepartment of Oncology and Children's Cancer Research Center, University Children's Hospital, 8032 Zurich, Switzerland.
Monika BrüggemannDepartment of Hematology, University Hospital Schleswig-Holstein, 24105 Kiel, Germany.
Karolina Bukowska-StrakovaDepartment of Clinical Immunology, Institute of Pediatrics, Jagiellonian University Medical College, 31-008 Krakow, Poland.ORCID 0000-0001-9181-439X
Hasan BurnusuzovCenter of Competence "PERIMED", Department of Pediatrics, Department of Microbiology and Clinical Immunology, Medical University Plovdiv, 4002 Plovdiv, Bulgaria.ORCID 0000-0002-3316-9916
Daniela CarelliHospital Guillermo Rawson, San Juan J5400, Argentina.
Günnur DenizDepartment of Immunology, Aziz Sancar Institute of Experimental Medicine, Istanbul University, 34452 Istanbul, Turkey.
Klara DubravčićDivision of Laboratory Immunology, Department of Laboratory Diagnostics, University Hospital Centre Zagreb & School of Medicine, 10000 Zagreb, Croatia.
Tamar FeuersteinThe Rina Zaizov Division of Pediatric Hematology-Oncology, Schneider's Children's Medical Center, Petah Tikva 4920235, Israel.
Marie Isabel GaillardBioquimica, Inmunologia, Hospital de Ninos Rocardo Gutierrez, Buenos Aires C1425EFD, Argentina.
Adriana GaleanoFlow Cytometry Laboratory, FUNDALEU, Buenos Aires C1114, Argentina.
Hugo GiordanoFundación Pérez Scremini, Pediatric Hematology-Oncology Service, Pereira Rossell Hospital, Montevideo 11600, Uruguay.
Alejandro GonzalezPAPSI Laboratorio Mendoza, Rosario S2000, Argentina.
Stefanie Groeneveld-KrentzDepartment of Pediatric Oncology and Hematology, Charité Berlin, 10117 Berlin, Germany.
Zsuzsanna HevessyDepartment of Laboratory Medicine, University of Debrecen, 4032 Debrecen, Hungary.ORCID 0000-0002-7364-9906
Ondrej HrusakDepartment of Paediatric Haematology and Oncology, University Hospital Motol, 150 06 Prague, Czech Republic.
Maria Belen IarossiFlow Cytometry Laboratory, Provincial Histocompatibility Reference Centre, CUCAIBA, Buenos Aires C1114, Argentina.
Pál JáksóFlow Cytometry Laboratory, Department of Pathology, Clinical Centre, University of Pécs, 7622 Pécs, Hungary.
Veronika Kloboves PrevodnikDepartment of Cytopathology, Institute of Oncology, 1000 Ljubljana, Slovenia.ORCID 0000-0002-0605-6596
Saskia KohlscheenDepartment of Hematology, University Hospital Schleswig-Holstein, 24105 Kiel, Germany.
Elena KreminskaClinical Laboratory Diagnostics and Metrology of NCSH "OHMATDYT", Ministry of Heath of Ukraine, 01601 Kiev, Ukraine.
Oscar MagliaM. Tettamanti Foundation Research Center, Department of Pediatrics, University of Milano-Bicocca, 20900 Monza, Italy.
Cecilia MalusardiHospital de Clinica Jose de San Martin, Buenos Aires C1120, Argentina.
Neda MarinovPINDA, Chilean National Pediatric Oncology Group, Hospital Roberto del Rio, Universidad de Chile, Santiago 8380418, Chile.ORCID 0000-0002-3588-4470
Bibiana Maria MartinLaboratorio CEBAC SRL, Posadas N3300, Argentina.
Claudia MöllerDepartment of Oncology and Children's Cancer Research Center, University Children's Hospital, 8032 Zurich, Switzerland.
Sergey NikulshinHematopathology and Flow Cytometry Division, Children's Clinical University Hospital, LV-1004 Riga, Latvia.ORCID 0000-0003-0059-2811
Jorge PalazziIICT Labs, Rosario S2000, Argentina.
Georgios PaterakisGeorgios Gennimatas General Hospital of Athens, 115 27 Athens, Greece.ORCID 0000-0001-9299-8346
Alexander PopovLaboratory of Leukemia Immunophenotyping, Dmitry Rogachev National Medical Research Center of Pediatric Hematology, Oncology and Immunology, 117997 Moscow, Russia.
Richard RateiClinic for Hematology and Tumor Immunology, HELIOS Klinikum Berlin-Buch, 13125 Berlin, Germany.
Cecilia RodríguezHospital Nacional de Clínicas, Universidad Nacional de Córdoba, Cordoba X5000HUA, Argentina.
Elisa Olga SajaroffCellular Immunology Laboratory, Hospital de Pediatria "Dr. Juan P. Garrahan", Buenos Aires C1245, Argentina.
Simona SalaM. Tettamanti Foundation Research Center, Department of Pediatrics, University of Milano-Bicocca, 20900 Monza, Italy.
Gordana SamardzijaLaboratory for Flow Cytometry and Immunology, Institute for Health and Protection of Mother and Child of Serbia, 11070 Belgrade, Serbia.
Mary SartorThe Children's Hospital at Westmead, Sydney, NSW 2145, Australia.
Pamela ScarparoPediatric Hematology, Oncology and Stem Cell Transplant Division, Maternal and Child Health Department, University of Padova, 35122 Padova, Italy.
Łukasz SędekDepartment of Microbiology and Immunology, Medical University of Silesia, 40-055 Katowice, Poland.ORCID 0000-0001-9384-914X
Bojana SlavkovicLaboratory for Flow Cytometry and Immunology, Institute for Health and Protection of Mother and Child of Serbia, 11070 Belgrade, Serbia.
Liliana SolariServicio de Bioquimica, Hospital Posadas, Buenos Aires B1684, Argentina.
Peter SvecNational Institute of Children's Diseases, 831 01 Bratislava, Slovakia.ORCID 0000-0002-7647-2253
Tomasz SzczepanskiDepartment of Pediatric Hematology and Oncology, Zabrze, Medical University of Silesia, 40-055 Katowice, Poland.ORCID 0000-0001-5336-261X
Anna TaparkouDepartment of Pediatric Oncology Hippokration General Hospital, 546 42 Thessaloniki, Greece.
Montserrat TorrebadellPediatric Hematology and Oncology, Hospital Sant Joan de Deu, 08950 Barcelona, Spain.
Marianna TzanoudakiDepartment of Immunology & Histocompatibility, "Agia Sophia" Children's Hospital, 115 27 Athens, Greece.
Elena VarottoPediatric Hematology, Oncology and Stem Cell Transplant Division, Maternal and Child Health Department, University of Padova, 35122 Padova, Italy.
Helly VernitskyHematology Lab, Sheba Medical Center, Ramat Gan 52621, Israel.
Andishe AttarbaschiSt. Anna Children's Hospital, Department of Pediatrics, Medical University of Vienna, 1090 Vienna, Austria.ORCID 0000-0002-9285-6898
Martin SchrappeDepartment of Pediatrics, University Medical Center SchleswigHolstein, Christian-Albrechts-University of Kiel, 24118 Kiel, Germany.
Valentino ConterClinica Pediatrica University degli Studi di Milano Biococca, Fondazione MBBM, 20900 Monza, Italy.
Andrea BiondiClinica Pediatrica University degli Studi di Milano Biococca, Fondazione MBBM, 20900 Monza, Italy.
Marisa FeliceDepartment of Hematology and Oncology, Hospital de Pediatria "Dr. Juan P. Garrahan", Buenos Aires C1245, Argentina.ORCID 0000-0002-7505-6549
Myriam CampbellPINDA, Chilean National Pediatric Oncology Group, Hospital Roberto del Rio, Universidad de Chile, Santiago 8380418, Chile.
Csongor KissDivision of Pediatric Hematology-Oncology, Department of Pediatrics, Faculty of Medicine, University of Debrecen, 4032 Debrecen, Hungary.ORCID 0000-0001-5170-5965
Giuseppe BassoPediatric Hematology, Oncology and Stem Cell Transplant Division, Maternal and Child Health Department, University of Padova, 35122 Padova, Italy.
Michael N DworzakChildren's Cancer Research Institute, Medical University of Vienna, 1090 Vienna, Austria.
On Behalf Of I-Bfm-Flow-Network
Funding
European Union's H2020 Research and Innovation Program 825749 "CLOSER"Polish Ministry of Health program 26.01.2019 / 42/772
Abstract
Monitoring of minimal residual disease (MRD) by flow cytometry (FCM) is a powerful prognostic tool for predicting outcomes in acute lymphoblastic leukemia (ALL). To apply FCM-MRD in large, collaborative trials, dedicated laboratory staff must be educated to concordantly high levels of expertise and their performance quality should be continuously monitored. We sought to install a unique and comprehensive training and quality control (QC) program involving a large number of reference laboratories within the international Berlin-Frankfurt-Münster (I-BFM) consortium, in order to complement the standardization of the methodology with an educational component and persistent quality control measures. Our QC and quality assurance (QA) program is based on four major cornerstones: (i) a twinning maturation program, (ii) obligatory participation in external QA programs (spiked sample send around, United Kingdom National External Quality Assessment Service (UK NEQAS)), (iii) regular participation in list-mode-data (LMD) file ring trials (FCM data file send arounds), and (iv) surveys of independent data derived from trial results. We demonstrate that the training of laboratories using experienced twinning partners, along with continuous educational feedback significantly improves the performance of laboratories in detecting and quantifying MRD in pediatric ALL patients. Overall, our extensive education and quality control program improved inter-laboratory concordance rates of FCM-MRD assessments and ultimately led to a very high conformity of risk estimates in independent patient cohorts.
Indexed as
acute lymphoblastic leukemiaflow cytometryminimal residual diseasequality control program
Identifiers
What OpenQuestion holds
Textmetadata
LicenceCC BY
Read underepoch 390
Registered trials
None linked
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.