Evidence map›Paper›PMID 35014198›Full record

ArticleThe journal of pathology. Clinical research2022

Semantic annotation for computational pathology: multidisciplinary experience and best practice recommendations.

Noorul Wahab, Islam M Miligy, Katherine Dodd, Harvir Sahota, Michael Toss, Wenqi Lu, Mostafa Jahanifar, Mohsin Bilal, Simon Graham, Young Park and 17 more

Abstract read
In one paragraph

Article in The journal of pathology. Clinical research, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 25 papers.

0numbers the graph read from it
0cells of the map it votes in
25citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

25 citing papers in PubMed.

  1. Article
  2. Fusion Annotator: A Platform for Accelerating Consensus-Driven Ground Truth Generation with AI Assistance.Proceedings of SPIE--the International Society for Optical Engineering · 2026
    Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Review
  8. Article
  9. Review
  10. Article
  11. Review
  12. Review
  13. Reproducible Reporting of the Collection and Evaluation of Annotations for Artificial Intelligence Models.Modern pathology : an official journal of the United States and Canadian Academy of Pathology, Inc · 2024
    Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Review
  19. Improving Representation Learning for Histopathologic Images with Cluster Constraints.Proceedings. IEEE International Conference on Computer Vision · 2023
    Article
  20. BRACS: A Dataset for BReAst Carcinoma Subtyping in H&E Histology Images.Database : the journal of biological databases and curation · 2022
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

27 authors.

Noorul WahabTissue Image Analytics Centre, University of Warwick, Coventry, UK.ORCID 0000-0002-1251-1559
Islam M MiligyPathology, University of Nottingham, Nottingham, UK.
Katherine DoddHistopathology, University Hospital Coventry and Warwickshire, Coventry, UK.
Harvir SahotaHistopathology, University Hospital Coventry and Warwickshire, Coventry, UK.
Michael TossPathology, University of Nottingham, Nottingham, UK.
Wenqi LuTissue Image Analytics Centre, University of Warwick, Coventry, UK.ORCID 0000-0002-7838-0918
Mostafa JahanifarTissue Image Analytics Centre, University of Warwick, Coventry, UK.
Mohsin BilalTissue Image Analytics Centre, University of Warwick, Coventry, UK.
Simon GrahamTissue Image Analytics Centre, University of Warwick, Coventry, UK.
Young ParkTissue Image Analytics Centre, University of Warwick, Coventry, UK.
Giorgos HadjigeorghiouTissue Image Analytics Centre, University of Warwick, Coventry, UK.
Abhir BhaleraoTissue Image Analytics Centre, University of Warwick, Coventry, UK.
Ayat G LashenPathology, University of Nottingham, Nottingham, UK.
Asmaa Y IbrahimPathology, University of Nottingham, Nottingham, UK.
Ayaka KatayamaGraduate School of Medicine, Gunma University, Maebashi, Japan.
Henry O EbiliPathology, University of Nottingham, Nottingham, UK.
Matthew ParkinPathology, University of Nottingham, Nottingham, UK.
Tom SorellDepartment of Politics and International Studies, University of Warwick, Coventry, UK.
Shan E Ahmed RazaTissue Image Analytics Centre, University of Warwick, Coventry, UK.
Emily HeroHistopathology, University Hospital Coventry and Warwickshire, Coventry, UK.
Hesham EldalyHistopathology, University Hospital Coventry and Warwickshire, Coventry, UK.
Yee Wah TsangHistopathology, University Hospital Coventry and Warwickshire, Coventry, UK.
Kishore GopalakrishnanHistopathology, University Hospital Coventry and Warwickshire, Coventry, UK.
David SneadHistopathology, University Hospital Coventry and Warwickshire, Coventry, UK.
Emad RakhaPathology, University of Nottingham, Nottingham, UK.
Nasir RajpootTissue Image Analytics Centre, University of Warwick, Coventry, UK.
Fayyaz MinhasTissue Image Analytics Centre, University of Warwick, Coventry, UK.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Recent advances in whole-slide imaging (WSI) technology have led to the development of a myriad of computer vision and artificial intelligence-based diagnostic, prognostic, and predictive algorithms. Computational Pathology (CPath) offers an integrated solution to utilise information embedded in pathology WSIs beyond what can be obtained through visual assessment. For automated analysis of WSIs and validation of machine learning (ML) models, annotations at the slide, tissue, and cellular levels are required. The annotation of important visual constructs in pathology images is an important component of CPath projects. Improper annotations can result in algorithms that are hard to interpret and can potentially produce inaccurate and inconsistent results. Despite the crucial role of annotations in CPath projects, there are no well-defined guidelines or best practices on how annotations should be carried out. In this paper, we address this shortcoming by presenting the experience and best practices acquired during the execution of a large-scale annotation exercise involving a multidisciplinary team of pathologists, ML experts, and researchers as part of the Pathology image data Lake for Analytics, Knowledge and Education (PathLAKE) consortium. We present a real-world case study along with examples of different types of annotations, diagnostic algorithm, annotation data dictionary, and annotation constructs. The analyses reported in this work highlight best practice recommendations that can be used as annotation guidelines over the lifecycle of a CPath project.

Indexed as

Artificial IntelligenceSemanticsAlgorithmsHumansPathologistsannotationscomputational pathologyguidelineswhole-slide images

Identifiers

PMID35014198
PMCPMC8822374

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.