Evidence map›Paper›PMID 35579553›Full record

ArticleGigaScience2022

NuCLS: A scalable crowdsourcing approach and dataset for nucleus classification and segmentation in breast cancer.

Mohamed Amgad, Lamees A Atteya, Hagar Hussein, Kareem Hosny Mohammed, Ehab Hafiz, Maha A T Elsebaie, Ahmed M Alhusseiny, Mohamed Atef AlMoslemany, Abdelmagid M Elmatboly, Philip A Pappalardo and 27 more

Abstract read
In one paragraph

Article in GigaScience, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 51 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
51citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

51 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Review
  8. Review
  9. Article
  10. Article
  11. Article
  12. Web engine for tumor pathology image retrievals on massive scales.bioRxiv : the preprint server for biology · 2025
    Article
  13. Article
  14. Article
  15. Article
  16. Review
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

37 authors.

Mohamed AmgadDepartment of Pathology, Northwestern University, 750 N Lake Shore Dr., Chicago, IL 60611, USA.ORCID 0000-0001-7599-6162
Lamees A AtteyaCairo Health Care Administration, Egyptian Ministry of Health, 3 Magles El Shaab Street, Cairo, Postal code 222, Egypt.
Hagar HusseinDepartment of Pathology, Nasser institute for research and treatment, 3 Magles El Shaab Street, Cairo, Postal code 222, Egypt.
Kareem Hosny MohammedDepartment of Pathology and Laboratory Medicine, University of Pennsylvania, 3620 Hamilton Walk M163, Philadelphia, PA 19104, USA.
Ehab HafizDepartment of Clinical Laboratory Research, Theodor Bilharz Research Institute, 1 El-Nile Street, Imbaba Warrak El-Hadar, Giza, Postal code 12411, Egypt.ORCID 0000-0002-1551-4309
Maha A T ElsebaieDepartment of Medicine, Cook County Hospital, 1969 W Ogden Ave, Chicago, IL 60612, USA.ORCID 0000-0001-8953-4030
Ahmed M AlhusseinyDepartment of Pathology, Baystate Medical Center, University of Massachusetts, 759 Chestnut St, Springfield, MA 01199, USA.ORCID 0000-0001-7317-0842
Mohamed Atef AlMoslemanyFaculty of Medicine, Menoufia University, Gamal Abd El-Nasir, Qism Shebeen El-Kom, Shibin el Kom, Menofia Governorate, Postal code: 32511, Egypt.
Abdelmagid M ElmatbolyFaculty of Medicine, Al-Azhar University, 15 Mohammed Abdou, El-Darb El-Ahmar, Cairo Governorate, Postal code 11651, Egypt.ORCID 0000-0001-6301-0191
Philip A PappalardoConsultant for The Center for Applied Proteomics and Molecular Medicine (CAPMM), George Mason University, 10920 George Mason Circle Institute for Advanced Biomedical Research Room 2008, MS1A9 Manassas, Virginia 20110, USA.
Rokia Adel SakrDepartment of Pathology, National Liver Institute, Gamal Abd El-Nasir, Qism Shebeen El-Kom, Shibin el Kom, Menofia Governorate, Postal code: 32511, Egypt.ORCID 0000-0002-5182-4961
Pooya MobadersanyDepartment of Pathology, Northwestern University, 750 N Lake Shore Dr., Chicago, IL 60611, USA.ORCID 0000-0001-9310-1983
Ahmad RachidFaculty of Medicine, Ain Shams University, 38 Abbassia, Next to the Al-Nour Mosque, Cairo, Postal code: 1181, Egypt.
Anas M SaadCleveland Clinic Foundation, 9500 Euclid Ave. Cleveland, Ohio 44195, USA.ORCID 0000-0003-0101-0131
Ahmad M AlkashashDepartment of Pathology, Indiana University, 635 Barnhill Drive Medical Science Building A-128 Indianapolis, IN 46202, USA.ORCID 0000-0002-5591-2467
Inas A RuhbanFaculty of Medicine, Damascus University, Damascus, Damaskus, PO Box 30621, Syria.
Anas AlrefaiFaculty of Medicine, Ain Shams University, 38 Abbassia, Next to the Al-Nour Mosque, Cairo, Postal code: 1181, Egypt.
Nada M ElgazarFaculty of Medicine, Mansoura University, 1 El Gomhouria St, Dakahlia Governorate 35516, Egypt.
Ali AbdulkarimFaculty of Medicine, Cairo University, Kasr Al Ainy Hospitals, Kasr Al Ainy St., Cairo, Postal code: 11562, Egypt.
Abo-Alela FaragFaculty of Medicine, Ain Shams University, 38 Abbassia, Next to the Al-Nour Mosque, Cairo, Postal code: 1181, Egypt.ORCID 0000-0001-7290-1404
Amira EtmanFaculty of Medicine, Menoufia University, Gamal Abd El-Nasir, Qism Shebeen El-Kom, Shibin el Kom, Menofia Governorate, Postal code: 32511, Egypt.ORCID 0000-0002-1331-5218
Ahmed G ElsaeedFaculty of Medicine, Mansoura University, 1 El Gomhouria St, Dakahlia Governorate 35516, Egypt.
Yahya AlaghaFaculty of Medicine, Cairo University, Kasr Al Ainy Hospitals, Kasr Al Ainy St., Cairo, Postal code: 11562, Egypt.
Yomna A AmerFaculty of Medicine, Menoufia University, Gamal Abd El-Nasir, Qism Shebeen El-Kom, Shibin el Kom, Menofia Governorate, Postal code: 32511, Egypt.
Ahmed M RaslanDepartment of Anaesthesia and Critical Care, Menoufia University Hospital, Gamal Abd El-Nasir, Qism Shebeen El-Kom, Shibin el Kom, Menofia Governorate, Postal code: 32511, Egypt.
Menatalla K NadimDepartment of Clinical Pathology, Ain Shams University, 38 Abbassia, Next to the Al-Nour Mosque, Cairo, Postal code: 1181, Egypt.ORCID 0000-0003-1506-3613
Mai A T ElsebaieFaculty of Medicine, Ain Shams University, 38 Abbassia, Next to the Al-Nour Mosque, Cairo, Postal code: 1181, Egypt.
Ahmed AyadResearch Department, Oncology Consultants, 2130 W. Holcombe Blvd, 10th Floor, Houston, Texas 77030, USA.
Liza E HannaDepartment of Pathology, Nasser institute for research and treatment, 3 Magles El Shaab Street, Cairo, Postal code 222, Egypt.
Ahmed GadallahFaculty of Medicine, Ain Shams University, 38 Abbassia, Next to the Al-Nour Mosque, Cairo, Postal code: 1181, Egypt.ORCID 0000-0002-4185-4841
Mohamed ElkadySiparadigm Diagnostic Informatics, 25 Riverside Dr no. 2, Pine Brook, NJ 07058, USA.ORCID 0000-0001-9327-8471
Bradley DrumhellerDepartment of Pathology and Laboratory Medicine, Emory University School of Medicine, 201 Dowman Dr, Atlanta, GA 30322, USA.
David JayeDepartment of Pathology and Laboratory Medicine, Emory University School of Medicine, 201 Dowman Dr, Atlanta, GA 30322, USA.ORCID 0000-0001-7977-6909
David MantheyKitware Inc., 1712 Route 9. Suite 300. Clifton Park, New York 12065, USA.ORCID 0000-0002-4580-8770
David A GutmanDepartment of Neurology, Emory University School of Medicine, 201 Dowman Dr, Atlanta, GA 30322, USA.ORCID 0000-0002-1386-8701
Habiba ElfandyDepartment of Pathology, National Cancer Institute, Kasr Al Eini Street, Fom El Khalig, Cairo, Postal code: 11562, Egypt.ORCID 0000-0003-0021-8731
Lee A D CooperDepartment of Pathology, Northwestern University, 750 N Lake Shore Dr., Chicago, IL 60611, USA.ORCID 0000-0002-3504-4965

Funding

Informatics Tools for Quantitative Digital Pathology Profiling and Integrated Prognostic ModelingU01CA220401 · NCI · NORTHWESTERN UNIVERSITY AT CHICAGO · PI COOPER, LEE, FLOWERS, CHRISTOPHER R · 2018 to 2021
$1.3M
NCI NIH HHS U01 CA220401NIH HHS U01CA220401
6 · The paper itself

Abstract

backgroundDeep learning enables accurate high-resolution mapping of cells and tissue structures that can serve as the foundation of interpretable machine-learning models for computational pathology. However, generating adequate labels for these structures is a critical barrier, given the time and effort required from pathologists.

resultsThis article describes a novel collaborative framework for engaging crowds of medical students and pathologists to produce quality labels for cell nuclei. We used this approach to produce the NuCLS dataset, containing >220,000 annotations of cell nuclei in breast cancers. This builds on prior work labeling tissue regions to produce an integrated tissue region- and cell-level annotation dataset for training that is the largest such resource for multi-scale analysis of breast cancer histology. This article presents data and analysis results for single and multi-rater annotations from both non-experts and pathologists. We present a novel workflow that uses algorithmic suggestions to collect accurate segmentation data without the need for laborious manual tracing of nuclei. Our results indicate that even noisy algorithmic suggestions do not adversely affect pathologist accuracy and can help non-experts improve annotation quality. We also present a new approach for inferring truth from multiple raters and show that non-experts can produce accurate annotations for visually distinctive classes.

conclusionsThis study is the most extensive systematic exploration of the large-scale use of wisdom-of-the-crowd approaches to generate data for computational pathology applications.

Indexed as

Breast NeoplasmsCrowdsourcingCell NucleusFemaleHumansMachine Learningbreast cancercrowdsourcingdeep learningnucleus classificationnucleus segmentation

Identifiers

PMID35579553
PMCPMC9112766

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.