ArticleMedical image analysis2023
The Liver Tumor Segmentation Benchmark (LiTS).
Abstract read
In one paragraph
Article in Medical image analysis, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 265 papers, 3 of them syntheses that pooled it.
0numbers the graph read from it
0cells of the map it votes in
265citing papers in PubMed, 3 pooled it
–field-weighted citation impact
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
265 citing papers in PubMed, 3 syntheses or guidelines pooled it.
- Demystifying Artificial Intelligence: A Systematic Review of Explainable Artificial Intelligence in Medical Imaging.Sensors (Basel, Switzerland) · 2026Pooled it
- Accuracy of Medical Image-Based Deep Learning for Detecting Microvascular Invasion in Hepatocellular Carcinoma: Systematic Review and Meta-Analysis.Journal of medical Internet research · 2026Pooled it
- Performance and clinical applicability of machine learning in liver computed tomography imaging: a systematic review.European radiology · 2023Pooled it
- Adapting Segment Anything Model 3 for concept-driven lesion segmentation in medical images: an experimental study.Visual computing for industry, biomedicine, and art · 2026Article
- AI-driven volumetric approach for automatic chemotherapy response assessment in colorectal liver metastases.European radiology · 2026Article
- A U-Net Transformer for magnetic resonance elastography.International journal of computer assisted radiology and surgery · 2026Article
- Hepatocellular Carcinoma Segmentation on MRI: Five-Fold ATLAS Benchmarking, Phase-Wise External Stress Testing, and Multiphasic OpenSwissHCC Ablation.Tomography (Ann Arbor, Mich.) · 2026Article
- Multi-Scale Residual Gated Attention U-Net for Liver Tumor Segmentation.Journal of imaging informatics in medicine · 2026Article
- Artificial intelligence in hepatocellular carcinoma diagnosis and AI-assisted treatment support: Current landscape and future directions.Liver research (Beijing, China) · 2026Review
- LiT-WSAG: high-precision 3D liver tumor segmentation via 2D training and 3D reconstruction.La Radiologia medica · 2026Article
- An explainable biomedical foundation model via large-scale concept-enhanced vision-language pretraining.Nature biomedical engineering · 2026Article
- Segment any tumour: an uncertainty-aware vision foundation model for whole-body analysis.Nature communications · 2026Article
- Generalist foundation models from a multimodal dataset for 3D computed tomography.Nature biomedical engineering · 2026Article
- MRI-based radiomics with automated segmentation and manual refinement for predicting treatment response in unresectable hepatocellular carcinoma: a multicenter study.Abdominal radiology (New York) · 2026Observational
- Multidimensional Dual Encoding Network For Liver Lesion Classification From Multi-Phase Magnetic Resonance Imaging.Journal of imaging informatics in medicine · 2026Article
- Liver Segment and Lesion Segmentation on CT and MRI: An Open-Source Contribution to TotalSegmentator.Journal of imaging informatics in medicine · 2026Article
- Beyond Size and Class Balance: Alpha as a New Dataset Quality Metric for Deep Learning.Bioengineering (Basel, Switzerland) · 2026Article
- Chinese expert concern and consensus on applications of artificial intelligence in clinical cancer imaging.Insights into imaging · 2026Article
- Large-Scale Multi-Cancer Detection by Learning Segmentation from Reports.Research square · 2026Article
- Language-Guided Segmentation of Medical Images: A Review of Foundation Models.Bioengineering (Basel, Switzerland) · 2026Review
205 more citing papers are in PubMed but not listed here.
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
109 authors.
Patrick BilicDepartment of Informatics, Technical University of Munich, Germany.
Patrick ChristDepartment of Informatics, Technical University of Munich, Germany.
Hongwei Bran LiDepartment of Informatics, Technical University of Munich, Germany; Department of Quantitative Biomedicine, University of Zurich, Switzerland. Electronic address: hongwei.li@tum.de.
Eugene VorontsovEcole Polytechnique de Montréal, Canada.
Avi Ben-CohenDepartment of Biomedical Engineering, Tel-Aviv University, Israel.
Georgios KaissisInstitute for AI in Medicine, Technical University of Munich, Germany; Institute for diagnostic and interventional radiology, Klinikum rechts der Isar, Technical University of Munich, Germany; Department of Computing, Imperial College London, London, United Kingdom.
Adi SzeskinSchool of Computer Science and Engineering, the Hebrew University of Jerusalem, Israel.
Colin JacobsDepartment of Medical Imaging, Radboud University Medical Center, Nijmegen, The Netherlands.
Gabriel Efrain Humpire MamaniDepartment of Medical Imaging, Radboud University Medical Center, Nijmegen, The Netherlands.
Gabriel ChartrandThe University of Montréal Hospital Research Centre (CRCHUM) Montréal, Québec, Canada.
Fabian LohöferInstitute for diagnostic and interventional radiology, Klinikum rechts der Isar, Technical University of Munich, Germany.
Julian Walter HolchDepartment of Medicine III, University Hospital, LMU Munich, Munich, Germany; Comprehensive Cancer Center Munich, Munich, Germany; Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany.
Wieland SommerDepartment of Radiology, University Hospital, LMU Munich, Germany.
Felix HofmannDepartment of General, Visceral and Transplantation Surgery, University Hospital, LMU Munich, Germany; Department of Radiology, University Hospital, LMU Munich, Germany.
Alexandre HostettlerDepartment of Surgical Data Science, Institut de Recherche contre les Cancers de l'Appareil Digestif (IRCAD), France.
Naama Lev-CohainDepartment of Radiology, Hadassah University Medical Center, Jerusalem, Israel.
Michal DrozdzalPolytechnique Montréal, Mila, QC, Canada.
Michal Marianne AmitaiDepartment of Diagnostic Radiology, Sheba Medical Center, Tel Aviv university, Israel.
Refael VivantiRafael Advanced Defense System, Israel.
Jacob SosnaDepartment of Radiology, Hadassah University Medical Center, Jerusalem, Israel.
Ivan EzhovDepartment of Informatics, Technical University of Munich, Germany.
Anjany SekuboyinaDepartment of Informatics, Technical University of Munich, Germany; Department of Quantitative Biomedicine, University of Zurich, Switzerland.
Fernando NavarroDepartment of Informatics, Technical University of Munich, Germany; Department of Radiation Oncology and Radiotherapy, Klinikum rechts der Isar, Technical University of Munich, Germany; TranslaTUM - Central Institute for Translational Cancer Research, Technical University of Munich, Germany.
Florian KoflerDepartment of Informatics, Technical University of Munich, Germany; Institute for diagnostic and interventional neuroradiology, Klinikum rechts der Isar,Technical University of Munich, Germany; Helmholtz AI, Helmholtz Zentrum München, Neuherberg, Germany; TranslaTUM - Central Institute for Translational Cancer Research, Technical University of Munich, Germany.
Johannes C PaetzoldDepartment of Computing, Imperial College London, London, United Kingdom; Institute for Tissue Engineering and Regenerative Medicine, Helmholtz Zentrum München, Neuherberg, Germany.
Suprosanna ShitDepartment of Informatics, Technical University of Munich, Germany.
Xiaobin HuDepartment of Informatics, Technical University of Munich, Germany.
Jana LipkováBrigham and Women's Hospital, Harvard Medical School, USA.
Markus RempflerDepartment of Informatics, Technical University of Munich, Germany.
Marie PiraudDepartment of Informatics, Technical University of Munich, Germany; Helmholtz AI, Helmholtz Zentrum München, Neuherberg, Germany.
Jan KirschkeInstitute for diagnostic and interventional neuroradiology, Klinikum rechts der Isar,Technical University of Munich, Germany.
Benedikt WiestlerInstitute for diagnostic and interventional neuroradiology, Klinikum rechts der Isar,Technical University of Munich, Germany.
Zhiheng ZhangDepartment of Hepatobiliary Surgery, the Affiliated Drum Tower Hospital of Nanjing University Medical School, China.
Christian HülsemeyerDepartment of Informatics, Technical University of Munich, Germany.
Marcel BeetzDepartment of Informatics, Technical University of Munich, Germany.
Florian EttlingerDepartment of Informatics, Technical University of Munich, Germany.
Michela AntonelliSchool of Biomedical Engineering & Imaging Sciences, King's College London, London, UK.
Woong BaeKakao Brain, Republic of Korea.
Míriam BellverBarcelona Supercomputing Center, Barcelona, Spain.
Lei BiSchool of Computer Science, the University of Sydney, Australia.
Hao ChenDepartment of Computer Science and Engineering, The Hong Kong University of Science and Technology, China.
Grzegorz ChlebusFraunhofer MEVIS, Bremen, Germany; Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, The Netherlands.
Erik B DamDepartment of Computer Science, University of Copenhagen, Denmark.
Qi DouDepartment of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China.
Chi-Wing FuDepartment of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China.
Bogdan GeorgescuSiemens Healthineers, USA.
Xavier Giró-I-NietoSignal Theory and Communications Department, Universitat Politecnica de Catalunya, Catalonia, Spain.
Felix GruenInstitute of Control Engineering, Technische Universität Braunschweig, Germany.
Xu HanDepartment of computer science, UNC Chapel Hill, USA.
Pheng-Ann HengDepartment of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China.
Jürgen HesserMannheim Institute for Intelligent Systems in Medicine, department of Medicine Mannheim, Heidelberg University, Germany; Interdisciplinary Center for Scientific Computing (IWR), Heidelberg University, Germany; Central Institute for Computer Engineering (ZITI), Heidelberg University, Germany.
Jan Hendrik MoltzFraunhofer MEVIS, Bremen, Germany.
Christian IgelDepartment of Computer Science, University of Copenhagen, Denmark.
Fabian IsenseeDivision of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany; Helmholtz Imaging, Germany.
Paul JägerDivision of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany; Helmholtz Imaging, Germany.
Fucang JiaShenzhen Institute of Advanced Technology, Chinese Academy of Sciences, China.
Krishna Chaitanya KaluvaMedical Imaging and Reconstruction Lab, Department of Engineering Design, Indian Institute of Technology Madras, India.
Mahendra KhenedMedical Imaging and Reconstruction Lab, Department of Engineering Design, Indian Institute of Technology Madras, India.
Ildoo KimKakao Brain, Republic of Korea.
Jae-Hun KimDepartment of Radiology, Samsung Medical Center, Sungkyunkwan University School of Medicine, South Korea.
Sungwoong KimKakao Brain, Republic of Korea.
Simon KohlDivision of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany.
Tomasz KonopczynskiInterdisciplinary Center for Scientific Computing (IWR), Heidelberg University, Germany.
Avinash KoriMedical Imaging and Reconstruction Lab, Department of Engineering Design, Indian Institute of Technology Madras, India.
Ganapathy KrishnamurthiMedical Imaging and Reconstruction Lab, Department of Engineering Design, Indian Institute of Technology Madras, India.
Fan LiSensetime, Shanghai, China.
Hongchao LiDepartment of Computer Science, Guangdong University of Foreign Studies, China.
Junbo LiPhilips Research China, Philips China Innovation Campus, Shanghai, China.
Xiaomeng LiDepartment of Electrical and Electronic Engineering, The University of Hong Kong, China.
John LowengrubDepartments of Mathematics, Biomedical Engineering, University of California, Irvine, USA; Center for Complex Biological Systems, University of California, Irvine, USA; Chao Family Comprehensive Cancer Center, University of California, Irvine, USA.
Jun MaDepartment of Mathematics, Nanjing University of Science and Technology, China.
Klaus Maier-HeinPattern Analysis and Learning Group, Department of Radiation Oncology, Heidelberg University Hospital, Heidelberg, Germany; Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany; Helmholtz Imaging, Germany.
Kevis-Kokitsi ManinisEidgenössische Technische Hochschule Zurich (ETHZ), Zurich, Switzerland.
Hans MeineFraunhofer MEVIS, Bremen, Germany; Medical Image Computing Group, FB3, University of Bremen, Germany.
Dorit MerhofInstitute of Imaging & Computer Vision, RWTH Aachen University, Germany.
Akshay PaiDepartment of Computer Science, University of Copenhagen, Denmark.
Mathias PerslevDepartment of Computer Science, University of Copenhagen, Denmark.
Jens PetersenDivision of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany.
Jordi Pont-TusetEidgenössische Technische Hochschule Zurich (ETHZ), Zurich, Switzerland.
Jin QiSchool of Information and Communication Engineering, University of Electronic Science and Technology of China, China.
Xiaojuan QiDepartment of Electrical and Electronic Engineering, The University of Hong Kong, China.
Oliver RippelInstitute of Imaging & Computer Vision, RWTH Aachen University, Germany.
Karsten RothUniversity of Tuebingen, Germany.
Ignacio SarasuaInstitute for diagnostic and interventional radiology, Klinikum rechts der Isar, Technical University of Munich, Germany; Department of Child and Adolescent Psychiatry, Ludwig-Maximilians-Universität, Munich, Germany.
Andrea SchenkFraunhofer MEVIS, Bremen, Germany; Institute for Diagnostic and Interventional Radiology, Hannover Medical School, Hannover, Germany.
Zengming ShenBeckman Institute, University of Illinois at Urbana-Champaign, USA; Siemens Healthineers, USA.
Jordi TorresBarcelona Supercomputing Center, Barcelona, Spain; Universitat Politecnica de Catalunya, Catalonia, Spain.
Christian WachingerDepartment of Informatics, Technical University of Munich, Germany; Institute for diagnostic and interventional radiology, Klinikum rechts der Isar, Technical University of Munich, Germany; Department of Child and Adolescent Psychiatry, Ludwig-Maximilians-Universität, Munich, Germany.
Chunliang WangDepartment of Biomedical Engineering and Health Systems, KTH Royal Institute of Technology, Sweden.
Leon WeningerInstitute of Imaging & Computer Vision, RWTH Aachen University, Germany.
Jianrong WuTencent Healthcare (Shenzhen) Co., Ltd, China.
Daguang XuNVIDIA, Santa Clara, CA, USA.
Xiaoping YangDepartment of Mathematics, Nanjing University, China.
Simon Chun-Ho YuDepartment of Imaging and Interventional Radiology, Chinese University of Hong Kong, Hong Kong, China.
Yading YuanDepartment of Radiation Oncology, Icahn School of Medicine at Mount Sinai, NY, USA.
Miao YueCGG Services (Singapore) Pte. Ltd., Singapore.
Liping ZhangDepartment of Imaging and Interventional Radiology, Chinese University of Hong Kong, Hong Kong, China.
Jorge CardosoSchool of Biomedical Engineering & Imaging Sciences, King's College London, London, UK.
Spyridon BakasCenter for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, PA, USA; Department of Radiology, Perelman School of Medicine, University of Pennsylvania, USA; Department of Pathology and Laboratory Medicine, Perelman School of Medicine, University of Pennsylvania, PA, USA.
Rickmer BrarenGerman Cancer Consortium (DKTK), Germany; Institute for diagnostic and interventional radiology, Klinikum rechts der Isar, Technical University of Munich, Germany; Comprehensive Cancer Center Munich, Munich, Germany.
Volker HeinemannDepartment of Hematology/Oncology & Comprehensive Cancer Center Munich, LMU Klinikum Munich, Germany.
Christopher PalEcole Polytechnique de Montréal, Canada.
An TangDepartment of Radiology, Radiation Oncology and Nuclear Medicine, University of Montréal, Canada.
Samuel KadouryEcole Polytechnique de Montréal, Canada.
Luc SolerDepartment of Surgical Data Science, Institut de Recherche contre les Cancers de l'Appareil Digestif (IRCAD), France.
Bram van GinnekenDepartment of Medical Imaging, Radboud University Medical Center, Nijmegen, The Netherlands.
Hayit GreenspanDepartment of Biomedical Engineering, Tel-Aviv University, Israel.
Leo JoskowiczSchool of Computer Science and Engineering, the Hebrew University of Jerusalem, Israel.
Bjoern MenzeDepartment of Informatics, Technical University of Munich, Germany; Department of Quantitative Biomedicine, University of Zurich, Switzerland.
Funding
Biomedical Image Computing and Informatics ClusterS10OD023495 · OD · UNIVERSITY OF PENNSYLVANIA · PI DAVATZIKOS, CHRISTOS · 2017 to 2017
$1.9MThe Federated Tumor Segmentation (FeTS) platform: An intuitive tool facilitating secure multi-institutional collaborationU01CA242871 · NCI · UNIVERSITY OF PENNSYLVANIA · PI BAKAS, SPYRIDON · 2019 to 2021
$1.1MNCI NIH HHS U01 CA242871NIH HHS S10 OD023495
Abstract
In this work, we report the set-up and results of the Liver Tumor Segmentation Benchmark (LiTS), which was organized in conjunction with the IEEE International Symposium on Biomedical Imaging (ISBI) 2017 and the International Conferences on Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2017 and 2018. The image dataset is diverse and contains primary and secondary tumors with varied sizes and appearances with various lesion-to-background levels (hyper-/hypo-dense), created in collaboration with seven hospitals and research institutions. Seventy-five submitted liver and liver tumor segmentation algorithms were trained on a set of 131 computed tomography (CT) volumes and were tested on 70 unseen test images acquired from different patients. We found that not a single algorithm performed best for both liver and liver tumors in the three events. The best liver segmentation algorithm achieved a Dice score of 0.963, whereas, for tumor segmentation, the best algorithms achieved Dices scores of 0.674 (ISBI 2017), 0.702 (MICCAI 2017), and 0.739 (MICCAI 2018). Retrospectively, we performed additional analysis on liver tumor detection and revealed that not all top-performing segmentation algorithms worked well for tumor detection. The best liver tumor detection method achieved a lesion-wise recall of 0.458 (ISBI 2017), 0.515 (MICCAI 2017), and 0.554 (MICCAI 2018), indicating the need for further research. LiTS remains an active benchmark and resource for research, e.g., contributing the liver-related segmentation tasks in http://medicaldecathlon.com/. In addition, both data and online evaluation are accessible via https://competitions.codalab.org/competitions/17094.
Indexed as
BenchmarkingLiver NeoplasmsAlgorithmsHumansImage Processing, Computer-AssistedLiverRetrospective StudiesBenchmarkCTDeep learningLiverLiver tumorSegmentation
Identifiers
What OpenQuestion holds
Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390
Registered trials
None linked
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.