Evidence map›Paper›PMID 34288586›Full record

ArticleThe journal of pathology. Clinical research2021

Quick Annotator: an open-source digital pathology based rapid image annotation tool.

Runtian Miao, Robert Toth, Yu Zhou, Anant Madabhushi, Andrew Janowczyk

Abstract read
In one paragraph

Article in The journal of pathology. Clinical research, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed.

  1. Article
  2. Review
  3. Review
  4. Article
  5. Article
  6. Review
  7. Review
  8. Article
  9. Article
  10. Review
  11. Review
  12. Article
  13. Article
  14. Article
  15. Article
  16. Towards a national strategy for digital pathology in Switzerland.Virchows Archiv : an international journal of pathology · 2022
    Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Runtian MiaoDepartment of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA.ORCID 0000-0002-2754-2630
Robert TothToth Technology LLC, Dover, NJ, USA.
Yu ZhouDepartment of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA.
Anant MadabhushiDepartment of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA.
Andrew JanowczykDepartment of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA.

Funding

Clinical and Translational Science Collaborative of ClevelandUL1TR002548 · NCATS · CASE WESTERN RESERVE UNIVERSITY · PI MCCOMSEY, GRACE A · 2018 to 2022
$35.5M
Pathology CoreU54CA254566 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI DOWLATI, AFSHIN · 2020 to 2024
$5.0M
Computerized histologic image predictor of cancer outcomeR01CA202752 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI FELDMAN, MICHAEL D, GANESAN, SHRIDAR · 2016 to 2020
$3.1M
Quantitative Histomorphometric Risk Classifier (QuHbIC) in HPV + Oropharyngeal CarcinomaR01CA220581 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI KOYFMAN, SHLOMO, LEWIS, JAMES · 2018 to 2023
$3.1M
Computerized Histologic Risk Predictor (CHiRP) for Early Stage Lung CancersR01CA216579 · NCI · EMORY UNIVERSITY · PI FU, PINGFU, LLOYD, MARK · 2018 to 2023
$3.1M
MR Fingerprinting and Computerized Decision Support for Prostate CancerR01CA208236 · NCI · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI GULANI, VIKAS, PONSKY, LEE EVAN · 2017 to 2022
$3.0M
Pathology Image Informatics Platform for visualization, analysis and managementU24CA199374 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI GURCAN, METIN NAFI, MADABHUSHI, ANANT · 2015 to 2019
$2.9M
RadxTools for assessing tumor treatment response on imagingU01CA248226 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI TIWARI, PALLAVI, VISWANATH, SATISH EASWAR · 2020 to 2022
$1.4M
HistoTools: A suite of digital pathology tools for quality control, annotation and dataset identificationU01CA239055 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI JANOWCZYK, ANDREW ROBERT, MADABHUSHI, ANANT · 2019 to 2022
$1.0M
A Study to Validate and Improve an Automated Image Analysis Algorithm to Detect Tuberculosis in Sputum Smear SlidesR43EB028736 · NIBIB · DIASCOPIC, LLC · PI MADABHUSHI, ANANT, SERIF, CARY · 2019 to 2019
$225k
BLRD VA IK6 BX006185NCATS NIH HHS UL1 TR002548NCI NIH HHS R01 CA202752NCI NIH HHS R01 CA208236NCI NIH HHS R01 CA216579NCI NIH HHS R01 CA220581NCI NIH HHS U01 CA239055NCI NIH HHS U01 CA248226NCI NIH HHS U24 CA199374NCI NIH HHS U54 CA254566NIBIB NIH HHS R43 EB028736
6 · The paper itself

Abstract

Image-based biomarker discovery typically requires accurate segmentation of histologic structures (e.g. cell nuclei, tubules, and epithelial regions) in digital pathology whole slide images (WSIs). Unfortunately, annotating each structure of interest is laborious and often intractable even in moderately sized cohorts. Here, we present an open-source tool, Quick Annotator (QA), designed to improve annotation efficiency of histologic structures by orders of magnitude. While the user annotates regions of interest (ROIs) via an intuitive web interface, a deep learning (DL) model is concurrently optimized using these annotations and applied to the ROI. The user iteratively reviews DL results to either (1) accept accurately annotated regions or (2) correct erroneously segmented structures to improve subsequent model suggestions, before transitioning to other ROIs. We demonstrate the effectiveness of QA over comparable manual efforts via three use cases. These include annotating (1) 337,386 nuclei in 5 pancreatic WSIs, (2) 5,692 tubules in 10 colorectal WSIs, and (3) 14,187 regions of epithelium in 10 breast WSIs. Efficiency gains in terms of annotations per second of 102×, 9×, and 39× were, respectively, witnessed while retaining f-scores >0.95, suggesting that QA may be a valuable tool for efficiently fully annotating WSIs employed in downstream biomarker studies.

Indexed as

Deep LearningImage Interpretation, Computer-AssistedMicroscopyPathologyAutomation, LaboratoryBiopsyCell NucleusColorectal NeoplasmsEpithelial CellsHigh-Throughput Screening AssaysHumansPredictive Value of TestsReproducibility of ResultsTime FactorsWorkflowactive learningannotationscomputational pathologydeep learningdigital pathologyefficiencyepitheliumnucleiopen-source tooltubules

Identifiers

PMID34288586
PMCPMC8503896

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.