ArticleArXiv2024
The Brain Tumor Segmentation - Metastases (BraTS-METS) Challenge 2023: Brain Metastasis Segmentation on Pre-treatment MRI.
Open access · greenAbstract readPreprint
In one paragraph
Article in ArXiv, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.
0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
1.0field-weighted citation impact, top 26% of its field
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
1 citing paper in PubMed, 4 citations in OpenAlex.
- AI-based augmentation of oncology clinical trials.Nature reviews. Clinical oncology · 2026Review
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
232 authors at 20 institutions in 29 countries.
Ahmed W MoawadTrinity health Mid Atlantic Hospitals, Darby, PA, USA.
Anastasia JanasDepartment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
Ujjwal BaidDivision of Computational Pathology, Department of Pathology and Laboratory Medicine, School of Medicine, Indiana University, Indianapolis, IN, USA.
Divya RamakrishnanDepartment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
Rachit SalujaDepartment of Electrical and Computer Engineering, Cornell University and Cornell Tech, New York, NY, USA.
Nader AshrafDepartment of Radiology, Children's Hospital of Philadelphia, Philadelphia, PA, USA.
Nazanin MalekiDepartment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
Leon JekelDKFZ Division of Translational Neurooncology at the WTZ, German Cancer Consortium, DKTK Partner Site, University Hospital Essen, Essen, Germany.
Nikolay YordanovFaculty of Medicine, Medical University - Sofia, Sofia, Bulgaria.
Pascal FehringerFaculty of Medicine, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany.
Athanasios GkampenisUniversity of Ioannina School of Medicine, Ioannina, Greece.
Raisa AmiruddinDepartment of Radiology, Children's Hospital of Philadelphia, Philadelphia, PA, USA.
Amirreza ManteghinejadDepartment of Radiology, Children's Hospital of Philadelphia, Philadelphia, PA, USA.
Maruf AdewoleMedical Artificial Intelligence Lab, Crestview Radiology, Lagos, Nigeria.
Jake AlbrechtSage Bionetworks, Seattle, WA, USA.
Udunna AnazodoMedical Artificial Intelligence Lab, Crestview Radiology, Lagos, Nigeria.
Sanjay AnejaDepartment of Therapeutic Radiology, Yale School of Medicine, New Haven, CT, USA.
Syed Muhammad AnwarSheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington, D.C., USA.
Timothy BergquistDepartment of Radiology, Mayo Clinic, Rochester, MN, USA.
Veronica ChiangDepartment of Neurosurgery, Yale School of Medicine, New Haven, CT, USA.
Verena ChungSage Bionetworks, Seattle, WA, USA.
Gian Marco ConteDepartment of Radiology, Mayo Clinic, Rochester, MN, USA.
Farouk DakoCenter for Global Health, Perelman School of Medicine, University of Pennsylvania, PA, USA.
James EddySage Bionetworks, Seattle, WA, USA.
Ivan EzhovDepartment of Informatics, Technical University Munich, Germany.
Nastaran KhaliliCenter for Data-Driven Discovery in Biomedicine, Children's Hospital of Philadelphia, Philadelphia, PA, USA.
Keyvan FarahaniCancer Imaging Program, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA.
Juan Eugenio IglesiasAthinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, USA.
Zhifan JiangChildren's National Hospital, Washington, D.C., USA.
Elaine JohansonPrecisionFDA, U.S. Food and Drug Administration, Silver Spring, MD, USA.
Anahita Fathi KazerooniCenter for Data-Driven Discovery in Biomedicine, Children's Hospital of Philadelphia, Philadelphia, PA, USA.
Florian KoflerDepartment of Neuroradiology, Technical University of Munich, Munich, Germany.
Kiril KrantchevDepartment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
Dominic LaBellaDepartment of Radiation Oncology, Duke University Medical Center, Durham, NC, USA.
Koen Van LeemputDepartment of Applied Mathematics and Computer Science, Technical University of Denmark, Denmark.
Hongwei Bran LiAthinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, USA.
Marius George LinguraruSheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington, D.C., USA.
Xinyang LiuChildren's National Hospital, Washington, D.C., USA.
Zeke MeierBooz Allen Hamilton, McLean, VA, USA.
Bjoern H MenzeBiomedical Image Analysis & Machine Learning, Department of Quantitative Biomedicine, University of Zurich, Switzerland.
Harrison MoyDepartment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
Klara OsenbergDepartment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
Marie PiraudHelmholtz AI, Helmholtz Munich, Germany.
Zachary ReitmanDepartment of Radiation Oncology, Duke University Medical Center, Durham, NC, USA.
Russell Takeshi ShinoharaCenter for Clinical Epidemiology and Biostatistics, University of Pennsylvania, Philadelphia, PA, USA.
Chunhao WangDepartment of Radiation Oncology, Duke University Medical Center, Durham, NC, USA.
Benedikt WiestlerDepartment of Neuroradiology, Technical University of Munich, Munich, Germany.
Walter WigginsDuke University School of Medicine, Durham, NC, USA.
Umber ShafiqueDepartment of Radiology and Imaging Sciences, Indiana University, Indianapolis, IN, USA.
Klara WillmsDepartment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
Arman AvestaDepartment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
Khaled BousabarahVisage Imaging, GmbH, Berlin, Germany.
Satrajit ChakrabartyDepartment of Electrical and Systems Engineering, Washington University in St. Louis, St. Louis, MO, USA.
Nicolo GennaroDepartment of Radiology, Northwestern University, Feinberg School of Medicine, Chicago, IL, USA.
Wolfgang HollerVisage Imaging, GmbH, Berlin, Germany.
Manpreet KaurLudwig Maximilian University, Munich, Germany.
Pamela LaMontagneMallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, MO, USA.
MingDe LinVisage Imaging, Inc, San Diego, CA, USA.
Jan LostDepartment of Neurosurgery, Heinrich-Heine University, Moorenstrasse 5, Dusseldorf, Germany.
Daniel S MarcusMallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, MO, USA.
Ryan MarescaDepartment of Therapeutic Radiology, Yale School of Medicine, New Haven, CT, USA.
Sarah MerkajUniversity of Ulm, Ulm, Germany.
Gabriel Cassinelli PedersenUniversity of Göttingen, Göttingen, Germany.
Marc von ReppertUniversity of Leipzig, Leipzig, Germany.
Aristeidis SotirasMallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, MO, USA.
Oleg TeytelboymTrinity health Mid Atlantic Hospitals, Darby, PA, USA.
Niklas TillmansDepartment of Diagnostic and Interventional Radiology, Medical Faculty, University Dusseldorf, Dusseldorf, Germany.
Malte WesterhoffVisage Imaging, GmbH, Berlin, Germany.
Ayda YoussefCairo University, Cairo, Egypt.
Devon GodfreyDepartment of Radiation Oncology, Duke University Medical Center, Durham, NC, USA.
Scott FloydDepartment of Radiation Oncology, Duke University Medical Center, Durham, NC, USA.
Andreas RauscheckerDepartment of Radiology and Biomedical Imaging, University of California San Francisco, CA, USA.
Javier Villanueva-MeyerDepartment of Radiology and Biomedical Imaging, University of California San Francisco, CA, USA.
Irada PflügerDepartment of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany.
Jaeyoung ChoDepartment of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany.
Martin BendszusDepartment of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany.
Gianluca BrugnaraDepartment of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany.
Justin CramerDepartment of Radiology, Mayo Clinic, Phoenix, AZ, USA.
Gloria J Guzman Perez-CarilloNeuroradiology Section, Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, MO, USA.
Derek R JohnsonDepartment of Radiology, Mayo Clinic, Rochester, MN, USA.
Anthony KamLoyola University Medical Center, Hines, IL, USA.
Benjamin Yin Ming KwanDepartment of Radiology, Queen's University, Kingston, ON, Canada.
Lillian LaiDepartment of Radiology, University of Iowa Hospitals and Clinics, Iowa City, IA, USA.
Neil U LallChildren's Healthcare of Atlanta, GA, USA.
Fatima MemonCarolina Radiology Associates, Myrtle Beach, SC, USA.
Mark KryciaCarolina Radiology Associates, Myrtle Beach, SC, USA.
Satya Narayana PatroUniversity of Arkansas Medical Center, Little Rock, AR, USA.
Bojan PetrovicNorthShore Endeavor Health, Evanston, IL, USA.
Tiffany Y SoDepartment of Imaging and Interventional Radiology, The Chinese University of Hong Kong, Hong Kong SAR.
Gerard ThompsonCentre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, United Kingdom.
Lei WuDepartment of Radiology, University of Washington, Seattle, WA, USA.
E Brooke SchrickelDepartment of Radiology, Ohio State University College of Medicine, Columbus, OH, USA.
Anu BansalAlbert Einstein Medical Center, Hartford, CT, USA.
Frederik BarkhofAmsterdam UMC, location Vrije Universiteir, Netherlands.
Cristina BesadaHospital Italiano de Buenos Aires, Buenos Aires, Argentina.
Sammy ChuDepartment of Radiology, University of Washington, Seattle, WA, USA.
Jason DruzgalDepartment of Radiology and Medical Imaging, University of Virginia, Charlottesville, Virginia, USA.
Alexandru DusoiKlinikum Hochrhein, Waldshut-Tiengen, Germany.
Luciano FarageCentro Universitario Euro-Americana (UNIEURO), Brasília, DF, Brazil.
Fabricio FeltrinDepartment of Radiology, University of Texas Southwestern Medical Center, Dallas, TX, USA.
Amy FongSouthern District Health Board, Dunedin, New Zealand.
Steve H FungDepartment of Radiology, Houston Methodist, Houston, TX, USA.
R Ian GrayUniversity of Tennessee Medical Center, Knoxville, TN, USA.
Ichiro IkutaDepartment of Radiology, Mayo Clinic, Phoenix, AZ, USA.
Michael IvDepartment of Radiology, Stanford University, Stanford, CA, USA.
Alida A PostmaDepartment of Radiology and Nuclear Medicine, Maastricht University Medical Center, Maastricht, the Netherlands.
Amit MahajanDepartment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
David JoynerDepartment of Radiology and Medical Imaging, University of Virginia, Charlottesville, Virginia, USA.
Chase KrumpelmanDepartment of Radiology, Northwestern University, Feinberg School of Medicine, Chicago, IL, USA.
Laurent Letourneau-GuillonCentre Hospitalier de l'Universite de Montreal and Centre de Recherche du CHUM Montreal, Canada.
Christie M LincolnDepartment of Neuroradiology, MD Anderson Cancer Center, Houston, TX, USA.
Mate E MarosDepartments of Neuroradiology & Biomedical Informatics, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany.
Elka MillerDepartment of Diagnostic and Interventional Radiology, SickKids Hospital, University of Toronto, Canada.
Fanny Esther A MorónDepartment of Radiology, Baylor College of Medicine, Houston, TX, USA.
Esther A NimchinskyDepartment of Radiology, New Jersey Medical School, Newark, NJ, USA.
Ozkan OzsarlakDepartment of Radiology, AZ Monica, Antwerp Area, Belgium.
Uresh PatelMedicolegal Imaging Experts LLC, Mercer Island, WA, USA.
Saurabh RohatgiDepartment of Radiology, Neuroradiology, Massachusetts General Hospital, Boston, MA, USA.
Atin SahaDepartment of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
Anousheh SayahMedStar Georgetown University Hospital, Washington, D.C., USA.
Eric D SchwartzDepartment of Radiology, St.Elizabeth's Medical Center, Boston, MA, USA.
Robert ShihWalter Reed National Military Medical Center, Bethesda, MD, USA.
Mark S ShiroishiKeck School of Medicine, Los Angeles, CA, USA.
Juan E SmallLahey Hospital and Medical Center, Burlington, MA, USA.
Manoj TanwarDepartment of Radiology, University of Alabama, Birmingham, AL, USA.
Jewels ValerieDepartment of Radiology, University of North Carolina School of Medicine, Chapel Hill, NC, USA.
Brent D WeinbergDepartment of Radiology and Imaging Sciences, Emory University, Atlanta, GA, USA.
Matthew L WhiteUniversity of Nebraska Medical Center, Omaha, NE, USA.
Robert YoungDepartment of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
Vahe M ZohrabianNorthwell Health, Zucker Hofstra School of Medicine at Northwell, North Shore University Hospital, Hempstead, New York, NY, USA.
Aynur AzizovaCancer Center Amsterdam, Imaging and Biomarkers, Amsterdam, The Netherlands.
Melanie Maria Theresa BrüßelerLudwig Maximilian University, Munich, Germany.
Mohanad GhonimDepartment of Radiology, Ain Shams University, Cairo, Egypt.
Mohamed GhonimDepartment of Radiology, Ain Shams University, Cairo, Egypt.
Abdullah OkarUniversity of Hamburg, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
Luca PasquiniDepartment of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
Yasaman SharifiDepartment of Radiology, Iran University of Medical Sciences, Tehran, Iran.
Gagandeep SinghColumbia University Irving Medical Center, New York, NY, USA.
Nico SollmannDepartment of Diagnostic and Interventional Radiology, University Hospital Ulm, Ulm, Germany.
Theodora SoumalaUniversity of Ioannina School of Medicine, Ioannina, Greece.
Mahsa TaherzadehDepartment of Radiology, Arad Hospital, Tehran, Iran.
Philipp VollmuthDepartment of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany.
Martha Foltyn-DumitruDepartment of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany.
Ajay MalhotraDepartment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
Aly H AbayazeedDepartment of Radiology, Stanford University, Stanford, CA, USA.
Francesco DellepianeFunctional and Interventional Neuroradiology Unit, Bambino Gesù Children's Hospital, Rome, Italy.
Philipp LohmannInstitute of Neuroscience and Medicine (INM-4), Research Center Juelich, Juelich, Germany.
Víctor M Pérez-GarcíaMathematical Oncology Laboratory & Department of Mathematics, University of Castilla-La Mancha, Spain.
Hesham ElhalawaniDepartment of Radiation Oncology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA.
Maria Correia de VerdierDepartment of Surgical Sciences, Section of Neuroradiology, Uppsala University, Sweden.
Sanaria Al-RubaieyCharité-Universitätsmedizin Berlin (Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health), Berlin, Germany.
Rui Duarte ArmindoDepartment of Neuroradiology, Western Lisbon Hospital Centre (CHLO), Portugal.
Kholod AshrafCairo University, Cairo, Egypt.
Moamen M AslaZagazig University, Zagazig, Egypt.
Mohamed BadawyDiagnostic Radiology Department, Wayne State University, Detroit, MI.
Jeroen BisschopInstitute of Diagnostic and Interventional Radiology, University Hospital Zurich, University of Zurich, Zurich, Switzerland.
Nima Broomand LomerFaculty of Medicine, Guilan University of Medical Sciences, Rasht, Iran.
Jan BukatzCharité-Universitätsmedizin Berlin (Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health), Berlin, Germany.
Jim ChenDepartment of Radiology/Division of Neuroradiology, San Diego Veterans Administration Medical Center/UC San Diego Health System, San Diego, CA, USA.
Petra CimflovaDepartment of Radiology, University of Calgary, Calgary, Canada.
Felix CorrEDU Institute of Higher Education, Villa Bighi, Chaplain's House, Kalkara, Malta.
Alexis CrawleyBay Imaging Consultants, Walnut Creek, CA, USA.
Lisa DeptulaRoss University School of Medicine, Bridgetown, Barbados.
Tasneem ElakhdarCairo University, Cairo, Egypt.
Islam H ShawaliCairo University, Cairo, Egypt.
Shahriar FaghaniDepartment of Radiology, Mayo Clinic, Rochester, MN, USA.
Alexandra FrickDepartment of Neurosurgery, Vivantes Klinikum Neukölln, Berlin, Germany.
Vaibhav GulatiMercy Catholic Medical Center, Darby, PA, USA.
Muhammad Ammar HaiderC.M.H. Lahore Medical College, Lahore, Pakistan.
Fátima HierroNeuroradiology Department, Pedro Hispano Hospital, Matosinhos, Portugal.
Rasmus Holmboe DahlDepartment of Radiology, Copenhagen University Hospital - Rigshospitalet, Copenhagen, Denmark.
Sarah Maria JacobsRijnstate Hospital, Arnhem, Netherlands.
Kuang-Chun Jim HsiehDepartment of Radiology, Baylor College of Medicine, Houston, TX, USA.
Sedat G KandemirliDepartment of Radiology, University of Iowa Hospitals and Clinics, Iowa City, IA, USA.
Katharina KerstingCharité-Universitätsmedizin Berlin (Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health), Berlin, Germany.
Laura KidaCharité-Universitätsmedizin Berlin (Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health), Berlin, Germany.
Sofia KolliaNational and Kapodistrian University of Athens, School of Medicine, Athens, Greece.
Ioannis KoukoulithrasDepartment of Neurosurgery, University Hospital of Ioannina, Ioannina, Greece.
Xiao LiDepartment of Radiology and Imaging Sciences, Emory University, Atlanta, GA, USA.
Ahmed AbouelattaCairo University, Cairo, Egypt.
Aya MansourCairo University, Cairo, Egypt.
Ruxandra-Catrinel Maria-ZamfirescuCharité-Universitätsmedizin Berlin (Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health), Berlin, Germany.
Marcela MarsigliaDepartment of Radiology, Brigham and Women's Hospital, Massachusetts General Hospital, Boston, MA, USA.
Yohana Sarahi Mateo-CamachoDepartment of Neuroradiology, Universidad Autónoma de Nuevo León, México.
Mark McArthurDepartment of Radiological Sciences, University of California Los Angeles, Los Angeles, CA, USA.
Olivia McDonnellGold Coast University Hospital, Queensland Health, Australia.
Maire McHughDepartment of Radiology Manchester NHS Foundation Trust, North West School of Radiology, Manchester, United Kingdom.
Mana MoassefiArtificial Intelligence Lab, Department of Radiology, Mayo Clinic, Rochester, MN, USA.
Samah Mostafa MorsiDepartment of Neuroradiology, MD Anderson Cancer Center, Houston, TX, USA.
Alexander MunteanuCorewell Health West, MI, USA.
Khanak K NandoliaDepartment of Radiodiagnosis, All India Institute of Medical Sciences Rishikesh, India.
Syed Raza NaqviWindsor Regional Hospital, Western University, Ontario, Canada.
Yalda NikanpourArtificial Intelligence & Informatics, Mayo Clinic, Rochester, MN, USA.
Mostafa AlnouryDepartment of Radiology, University of Pennsylvania, PA, USA.
Abdullah Mohamed Aly NouhDepartment of Radiology, Life Care Hospital, Freetown, Sierra Leone.
Francesca PappafavaDepartment of Medicine and Surgery, Università degli Studi di Perugia, Italy.
Markand D PatelDepartment of Neuroradiology, Imperial College Healthcare NHS Trust, London, United Kingdom.
Samantha PetrucciDepartment of Radiology and Biomedical Imaging, University of California San Francisco, CA, USA.
Eric RawieDepartment of Radiology, Michigan Medicine, Ann Arbor, MI, USA.
Scott RaymondDepartment of Radiology, University of Vermont Medical Center, Burlington, VT, USA.
Borna RoohaniUniversity of Hamburg, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
Sadeq SabouhiIsfahan University of Medical Sciences, Isfahan, Iran.
Laura M Sanchez-GarciaDepartment of Radiology, The American British Cowdray Medical Center, Mexico City, Mexico.
Zoe ShakedCharité-Universitätsmedizin Berlin (Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health), Berlin, Germany.
Pokhraj P SutharRush University Medical Center, Chicago, IL, USA.
Talissa AltesRadiology Department, University of Missouri, Columbia, MO, USA.
Edvin IsufiRadiology Department, University of Missouri, Columbia, MO, USA.
Yaseen DhemeshWashington University School of Medicine in St. Louis, St. Louis, MO, USA.
Jaime GassRadiology Department, University of Missouri, Columbia, MO, USA.
Jonathan ThackerRadiology Department, University of Missouri, Columbia, MO, USA.
Abdul Rahman TarabishyDepartment of NeuroRadiology, Rockefeller Neuroscience Institute, West Virginia University. Morgantown, WV, USA.
Benjamin TurnerLeeds Teaching Hospitals NHS Trust, Leeds, United Kingdom.
Sebastiano VaccaUniversity of Cagliari, School of Medicine and Surgery, Cagliari, Italy.
George K VilanilamLeeds Teaching Hospitals NHS Trust, Leeds, United Kingdom.
Daniel WarrenWashington University School of Medicine in St. Louis, St. Louis, MO, USA.
David WeissDepartment of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen, Essen, Germany.
Fikadu WoredeDepartment of Radiology, Children's Hospital of Philadelphia, Philadelphia, PA, USA.
Sara YousryCairo University, Cairo, Egypt.
Wondwossen LereboDepartment of Radiology, Children's Hospital of Philadelphia, Philadelphia, PA, USA.
Alejandro AristizabalMLCommons, San Francisco, CA, USA.
Alexandros KarargyrisMLCommons, San Francisco, CA, USA.
Hasan KassemMLCommons, San Francisco, CA, USA.
Sarthak PatiDivision of Computational Pathology, Department of Pathology and Laboratory Medicine, School of Medicine, Indiana University, Indianapolis, IN, USA.
Micah ShellerMLCommons, San Francisco, CA, USA.
Katherine E Evan LinkNew York University School of Medicine, New York, NY, USA.
Evan CalabreseDepartment of Radiology, Duke University Medical Center, Durham, NC, USA.
Nourel Hoda TahonRadiology Department, University of Missouri, Columbia, MO, USA.
Ayman NadaRadiology Department, University of Missouri, Columbia, MO, USA.
Yuri S VelichkoDepartment of Radiology, Northwestern University, Feinberg School of Medicine, Chicago, IL, USA.
Spyridon BakasDivision of Computational Pathology, Department of Pathology and Laboratory Medicine, School of Medicine, Indiana University, Indianapolis, IN, USA.
Jeffrey D RudieDepartment of Radiology, University of California San Diego, CA, USA.
Mariam AboianDepartment of Radiology, Children's Hospital of Philadelphia, Philadelphia, PA, USA.
Yale University · USChildren's Hospital of Philadelphia · USCairo University · EGChildren's National · USNorthwestern University · USSage Bionetworks · USUniversity of California, San Francisco · USWashington University in St. Louis · USAin Shams University · EGBrigham and Women's Hospital · USDuke Medical Center · USDuke University · USMayo Clinic in Arizona · USMemorial Sloan Kettering Cancer Center · USBaylor College of Medicine · USEmory University · USHeidelberg University · DEMassachusetts General Hospital · USTrinity Health · USUniversity of Missouri · US
Funding
The Federated Tumor Segmentation (FeTS) platform: An intuitive tool facilitating secure multi-institutional collaborationU01CA242871 · NCI · UNIVERSITY OF PENNSYLVANIA · PI BAKAS, SPYRIDON · 2019 to 2021
$1.1MTranslation and validation of non-invasive measurement of PD-L1 levels with positron emission tomography (PET) in head and neck malignancies and intracranial metastasesR21CA259964 · NCI · YALE UNIVERSITY · PI CHAPIRO, JULIUS · 2022 to 2023
$428kNCI NIH HHS R21 CA259964NCI NIH HHS U01 CA242871
Abstract
The translation of AI-generated brain metastases (BM) segmentation into clinical practice relies heavily on diverse, high-quality annotated medical imaging datasets. The BraTS-METS 2023 challenge has gained momentum for testing and benchmarking algorithms using rigorously annotated internationally compiled real-world datasets. This study presents the results of the segmentation challenge and characterizes the challenging cases that impacted the performance of the winning algorithms. Untreated brain metastases on standard anatomic MRI sequences (T1, T2, FLAIR, T1PG) from eight contributed international datasets were annotated in stepwise method: published UNET algorithms, student, neuroradiologist, final approver neuroradiologist. Segmentations were ranked based on lesion-wise Dice and Hausdorff distance (HD95) scores. False positives (FP) and false negatives (FN) were rigorously penalized, receiving a score of 0 for Dice and a fixed penalty of 374 for HD95. The mean scores for the teams were calculated. Eight datasets comprising 1303 studies were annotated, with 402 studies (3076 lesions) released on Synapse as publicly available datasets to challenge competitors. Additionally, 31 studies (139 lesions) were held out for validation, and 59 studies (218 lesions) were used for testing. Segmentation accuracy was measured as rank across subjects, with the winning team achieving a LesionWise mean score of 7.9. The Dice score for the winning team was 0.65 ± 0.25. Common errors among the leading teams included false negatives for small lesions and misregistration of masks in space. The Dice scores and lesion detection rates of all algorithms diminished with decreasing tumor size, particularly for tumors smaller than 100 mm3. In conclusion, algorithms for BM segmentation require further refinement to balance high sensitivity in lesion detection with the minimization of false positives and negatives. The BraTS-METS 2023 challenge successfully curated well-annotated, diverse datasets and identified common errors, facilitating the translation of BM segmentation across varied clinical environments and providing personalized volumetric reports to patients undergoing BM treatment.
Indexed as
Artificial IntelligenceBrain metastasisBrain tumor segmentationBraTSBraTS-METSMachine learningMedical image analysis challenge
Identifiers
PMID
37396600PMC
PMC10312806OpenAlex
W4382919244What OpenQuestion holds
Textmetadata
LicenceCC BY
Read underepoch 390
Registered trials
None linked
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.