Evidence map›Paper›PMID 34255661›Full record

ArticleJournal of medical Internet research2021

Clinically Applicable Segmentation of Head and Neck Anatomy for Radiotherapy: Deep Learning Algorithm Development and Validation Study.

Stanislav Nikolov, Sam Blackwell, Alexei Zverovitch, Ruheena Mendes, Michelle Livne, Jeffrey De Fauw, Yojan Patel, Clemens Meyer, Harry Askham, Bernadino Romera-Paredes and 19 more

Open access · goldAbstract read
In one paragraph

Article in Journal of medical Internet research, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 249 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
249citing papers in PubMed, 3 pooled it
43.0field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

249 citing papers in PubMed, 3 syntheses or guidelines pooled it, 320 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Freehand 3D ultrasound imaging of the femoral head and neck.International journal of computer assisted radiology and surgery · 2026
    Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
  20. Article

189 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

29 authors at 5 institutions in 1 country.

Stanislav Nikolov *DeepMind, London, United Kingdom.ORCID 0000-0001-8234-0751
Sam Blackwell *DeepMind, London, United Kingdom.ORCID 0000-0001-8730-3036
Alexei Zverovitch *Google Health, London, United Kingdom.ORCID 0000-0002-0567-5440
Ruheena MendesUniversity College London Hospitals NHS Foundation Trust, London, United Kingdom.ORCID 0000-0003-4754-1181
Michelle LivneGoogle Health, London, United Kingdom.ORCID 0000-0002-8277-4733
Jeffrey De FauwDeepMind, London, United Kingdom.ORCID 0000-0001-6971-5678
Yojan PatelGoogle Health, London, United Kingdom.ORCID 0000-0001-6397-6279
Clemens MeyerDeepMind, London, United Kingdom.ORCID 0000-0003-1165-6104
Harry AskhamDeepMind, London, United Kingdom.ORCID 0000-0003-1530-4683
Bernadino Romera-ParedesDeepMind, London, United Kingdom.ORCID 0000-0003-3604-3590
Christopher KellyGoogle Health, London, United Kingdom.ORCID 0000-0002-1246-844X
Alan KarthikesalingamGoogle Health, London, United Kingdom.ORCID 0000-0001-5074-898X
Carlton ChuDeepMind, London, United Kingdom.ORCID 0000-0001-8282-6364
Dawn CarnellUniversity College London Hospitals NHS Foundation Trust, London, United Kingdom.ORCID 0000-0002-2898-3219
Cheng BoonClatterbridge Cancer Centre NHS Foundation Trust, Liverpool, United Kingdom.ORCID 0000-0003-2652-9263
Derek D'SouzaUniversity College London Hospitals NHS Foundation Trust, London, United Kingdom.ORCID 0000-0002-4393-7683
Syed Ali MoinuddinUniversity College London Hospitals NHS Foundation Trust, London, United Kingdom.ORCID 0000-0002-8955-8224
Bethany GarieDeepMind, London, United Kingdom.ORCID 0000-0003-3538-9063
Yasmin McQuinlanDeepMind, London, United Kingdom.ORCID 0000-0002-8464-0640
Sarah IrelandDeepMind, London, United Kingdom.ORCID 0000-0002-2975-2447
Kiarna HamptonDeepMind, London, United Kingdom.ORCID 0000-0002-4384-6108
Krystle FullerDeepMind, London, United Kingdom.ORCID 0000-0003-0706-6857
Hugh MontgomeryUniversity College London, London, United Kingdom.ORCID 0000-0001-8797-5019
Geraint ReesUniversity College London, London, United Kingdom.ORCID 0000-0002-9623-7007
Mustafa SuleymanGoogle, London, United Kingdom.ORCID 0000-0002-5415-4457
Trevor BackDeepMind, London, United Kingdom.ORCID 0000-0002-0567-8043
Cían Owen Hughes *Google Health, London, United Kingdom.ORCID 0000-0001-6901-0985
Joseph R Ledsam *Google AI, Tokyo, Japan.ORCID 0000-0001-9917-7196
Olaf Ronneberger *DeepMind, London, United Kingdom.ORCID 0000-0002-4266-1515
Google DeepMind (United Kingdom) · GBGoogle (United Kingdom) · GBUniversity College London Hospitals NHS Foundation Trust · GBUniversity College London · GBClatterbridge Cancer Centre NHS Foundation Trust · GB

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundOver half a million individuals are diagnosed with head and neck cancer each year globally. Radiotherapy is an important curative treatment for this disease, but it requires manual time to delineate radiosensitive organs at risk. This planning process can delay treatment while also introducing interoperator variability, resulting in downstream radiation dose differences. Although auto-segmentation algorithms offer a potentially time-saving solution, the challenges in defining, quantifying, and achieving expert performance remain.

objectiveAdopting a deep learning approach, we aim to demonstrate a 3D U-Net architecture that achieves expert-level performance in delineating 21 distinct head and neck organs at risk commonly segmented in clinical practice.

methodsThe model was trained on a data set of 663 deidentified computed tomography scans acquired in routine clinical practice and with both segmentations taken from clinical practice and segmentations created by experienced radiographers as part of this research, all in accordance with consensus organ at risk definitions.

resultsWe demonstrated the model's clinical applicability by assessing its performance on a test set of 21 computed tomography scans from clinical practice, each with 21 organs at risk segmented by 2 independent experts. We also introduced surface Dice similarity coefficient, a new metric for the comparison of organ delineation, to quantify the deviation between organ at risk surface contours rather than volumes, better reflecting the clinical task of correcting errors in automated organ segmentations. The model's generalizability was then demonstrated on 2 distinct open-source data sets, reflecting different centers and countries to model training.

conclusionsDeep learning is an effective and clinically applicable technique for the segmentation of the head and neck anatomy for radiotherapy. With appropriate validation studies and regulatory approvals, this system could improve the efficiency, consistency, and safety of radiotherapy pathways.

Indexed as

Deep LearningHead and Neck NeoplasmsAlgorithmsHumansTomography, X-Ray Computedartificial intelligencecontouringconvolutional neural networksmachine learningradiotherapysegmentationsurface DSCUNet

Identifiers

PMID34255661
PMCPMC8314151
OpenAlexW3180629942

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.