Evidence map›Paper›PMID 38263232›Full record

ArticleScientific reports2024

Assessing generalisability of deep learning-based polyp detection and segmentation methods through a computer vision challenge.

Sharib Ali, Noha Ghatwary, Debesh Jha, Ece Isik-Polat, Gorkem Polat, Chen Yang, Wuyang Li, Adrian Galdran, Miguel-Ángel González Ballester, Vajira Thambawita and 22 more

Open access · goldAbstract read
In one paragraph

Article in Scientific reports, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 28 papers.

0numbers the graph read from it
0cells of the map it votes in
28citing papers in PubMed
11.6field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

28 citing papers in PubMed, 47 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Machine learning in healthcare citizen science: A scoping review.International journal of medical informatics · 2025
    Article
  14. Article
  15. Body Surface Potential Mapping: A Perspective on High-Density Cutaneous Electrophysiology.Advanced science (Weinheim, Baden-Wurttemberg, Germany) · 2025
    Review
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

32 authors at 20 institutions in 13 countries.

Sharib AliSchool of Computing, Faculty of Engineering and Physical Sciences, University of Leeds, Leeds, LS2 9JT, UK. s.s.ali@leeds.ac.uk.
Noha GhatwaryComputer Engineering Department, Arab Academy for Science and Technology, Smart Village, Giza, Egypt.
Debesh JhaSimulaMet, 0167, Oslo, Norway.
Ece Isik-PolatGraduate School of Informatics, Middle East Technical University, 06800, Ankara, Turkey.
Gorkem PolatGraduate School of Informatics, Middle East Technical University, 06800, Ankara, Turkey.
Chen YangCity University of Hong Kong, Kowloon, Hong Kong.
Wuyang LiCity University of Hong Kong, Kowloon, Hong Kong.
Adrian GaldranBCN MedTech, Department of Information and Communication Technologies, Universitat Pompeu Fabra, 08018, Barcelona, Spain.
Miguel-Ángel González BallesterBCN MedTech, Department of Information and Communication Technologies, Universitat Pompeu Fabra, 08018, Barcelona, Spain.
Vajira ThambawitaSimulaMet, 0167, Oslo, Norway.
Steven HicksSimulaMet, 0167, Oslo, Norway.
Sahadev PoudelDepartment of IT Convergence Engineering, Gachon University, Seongnam, 13120, Republic of Korea.
Sang-Woong LeeDepartment of IT Convergence Engineering, Gachon University, Seongnam, 13120, Republic of Korea.
Ziyi JinCollege of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou, 310027, China.
Tianyuan GanCollege of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou, 310027, China.
ChengHui YuTsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen, 518055, China.
JiangPeng YanDepartment of Automation, Tsinghua University, Beijing, 100084, China.
Doyeob YeoSmart Sensing and Diagnosis Research Division, Korea Atomic Energy Research Institute, Taejon, 34057, Republic of Korea.
Hyunseok LeeDaegu-Gyeongbuk Medical Innovation Foundation, Medical Device Development Center, Taegu, 427724, Republic of Korea.
Nikhil Kumar TomarNepAL Applied Mathematics and Informatics Institute for Research (NAAMII), Kathmandu, Nepal.
Mahmood HaithamiComputer Science Department, University of Nottingham, Malaysia Campus, 43500, Semenyih, Malaysia.
Amr AhmedComputer Science, Edge Hill University, Lancashire, United Kingdom.
Michael A RieglerSimulaMet, 0167, Oslo, Norway.
Christian DaulCRAN UMR 7039, Université de Lorraine and CNRS, 54500, Vandœuvre-Lès-Nancy, France.
Pål HalvorsenSimulaMet, 0167, Oslo, Norway.
Jens RittscherDepartment of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford, OX3 7DQ, UK.
Osama E SalemFaculty of Medicine, University of Alexandria, Alexandria, 21131, Egypt.
Dominique LamarqueUniversité de Versailles St-Quentin en Yvelines, Hôpital Ambroise Paré, 9 Av. Charles de Gaulle, 92100, Boulogne-Billancourt, France.
Renato Cannizzaro *CRO Centro Riferimento Oncologico IRCCS Aviano Italy, Via Franco Gallini, 2, 33081, Aviano, PN, Italy.
Stefano Realdon *CRO Centro Riferimento Oncologico IRCCS Aviano Italy, Via Franco Gallini, 2, 33081, Aviano, PN, Italy.
Thomas de Lange *Medical Department, Sahlgrenska University Hospital-Mölndal, Blå stråket 5, 413 45, Göteborg, Sweden.
James E East *Oxford National Institute for Health Research Biomedical Research Centre, Oxford, OX4 2PG, UK.
Simula Metropolitan Center for Digital Engineering · NOCity University of Hong Kong · HKGachon University · KRMiddle East Technical University · TRTsinghua University · CNZhejiang University · CNAlexandria University · EGArab Academy for Science, Technology, and Maritime Transport · EGCentre National de la Recherche Scientifique · FRCentro di Riferimento Oncologico · ITDaegu-Gyeongbuk Medical Innovation Foundation · KREdge Hill University · GBHôpital Ambroise-Paré · FRInstitució Catalana de Recerca i Estudis Avançats · ESInstitute for Social and Environmental Research-Nepal · NPIstituto Oncologico Veneto · ITJohn Radcliffe Hospital · GBKorea Atomic Energy Research Institute · KROsloMet – Oslo Metropolitan University · NOSahlgrenska University Hospital · SE

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Polyps are well-known cancer precursors identified by colonoscopy. However, variability in their size, appearance, and location makes the detection of polyps challenging. Moreover, colonoscopy surveillance and removal of polyps are highly operator-dependent procedures and occur in a highly complex organ topology. There exists a high missed detection rate and incomplete removal of colonic polyps. To assist in clinical procedures and reduce missed rates, automated methods for detecting and segmenting polyps using machine learning have been achieved in past years. However, the major drawback in most of these methods is their ability to generalise to out-of-sample unseen datasets from different centres, populations, modalities, and acquisition systems. To test this hypothesis rigorously, we, together with expert gastroenterologists, curated a multi-centre and multi-population dataset acquired from six different colonoscopy systems and challenged the computational expert teams to develop robust automated detection and segmentation methods in a crowd-sourcing Endoscopic computer vision challenge. This work put forward rigorous generalisability tests and assesses the usability of devised deep learning methods in dynamic and actual clinical colonoscopy procedures. We analyse the results of four top performing teams for the detection task and five top performing teams for the segmentation task. Our analyses demonstrate that the top-ranking teams concentrated mainly on accuracy over the real-time performance required for clinical applicability. We further dissect the devised methods and provide an experiment-based hypothesis that reveals the need for improved generalisability to tackle diversity present in multi-centre datasets and routine clinical procedures.

Indexed as

CrowdsourcingDeep LearningPolypsColonoscopyComputersHumans

Identifiers

PMID38263232
PMCPMC10805888
OpenAlexW4391145465

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.