Evidence map›Paper›PMID 36400937›Full record

ArticleCommunications biology2022

UnMICST: Deep learning with real augmentation for robust segmentation of highly multiplexed images of human tissues.

Clarence Yapp, Edward Novikov, Won-Dong Jang, Tuulia Vallius, Yu-An Chen, Marcelo Cicconet, Zoltan Maliga, Connor A Jacobson, Donglai Wei, Sandro Santagata and 2 more

Abstract read
In one paragraph

Article in Communications biology, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 35 papers.

0numbers the graph read from it
0cells of the map it votes in
35citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

35 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Review
  5. SEAL: Spatially-resolved Embedding Analysis with Linked Imaging Data.IEEE transactions on visualization and computer graphics · 2026
    Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. SEAL : Spatially-resolved Embedding Analysis with Linked Imaging Data.bioRxiv : the preprint server for biology · 2025
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Clarence Yapp *Laboratory of Systems Pharmacology, Harvard Medical School, Boston, MA, 02115, USA.ORCID 0000-0003-1144-5710
Edward Novikov *Laboratory of Systems Pharmacology, Harvard Medical School, Boston, MA, 02115, USA.
Won-Dong JangLaboratory of Systems Pharmacology, Harvard Medical School, Boston, MA, 02115, USA.
Tuulia ValliusLaboratory of Systems Pharmacology, Harvard Medical School, Boston, MA, 02115, USA.
Yu-An ChenLaboratory of Systems Pharmacology, Harvard Medical School, Boston, MA, 02115, USA.
Marcelo CicconetImage and Data Analysis Core, Harvard Medical School, Boston, MA, 02115, USA.
Zoltan MaligaLaboratory of Systems Pharmacology, Harvard Medical School, Boston, MA, 02115, USA.ORCID 0000-0003-4209-7253
Connor A JacobsonLaboratory of Systems Pharmacology, Harvard Medical School, Boston, MA, 02115, USA.ORCID 0000-0002-0299-3451
Donglai WeiSchool of Engineering and Applied Sciences, Harvard University, Cambridge, MA, 02138, USA.
Sandro SantagataLaboratory of Systems Pharmacology, Harvard Medical School, Boston, MA, 02115, USA.ORCID 0000-0002-7528-9668
Hanspeter PfisterSchool of Engineering and Applied Sciences, Harvard University, Cambridge, MA, 02138, USA.
Peter K SorgerLaboratory of Systems Pharmacology, Harvard Medical School, Boston, MA, 02115, USA. peter_sorger@hms.harvard.edu.ORCID 0000-0002-3364-1838

Funding

VectorP30CA006516 · NCI · DANA-FARBER CANCER INSTITUTE · PI JENNIFER W MACK · 1985 to 2026
$330.6M
Systems Pharmacology of Therapeutic and Adverse Responses to ImmuneCheckpoint and Small Molecule DrugsU54CA225088 · NCI · HARVARD MEDICAL SCHOOL · PI HAIGIS, MARCIA · 2018 to 2022
$10.8M
Pre-cancer atlases of cutaneous and hematologic origin (PATCH Center)U2CCA233262 · NCI · HARVARD MEDICAL SCHOOL · PI SANTAGATA, SANDRO, SORGER, PETER KARL · 2018 to 2023
$8.7M
High dimensional digital pathology to investigate the tumor micro environment and its impact on response to therapyR50CA252138 · NCI · HARVARD MEDICAL SCHOOL · PI MALIGA, ZOLTAN · 2020 to 2024
$1.0M
NCI NIH HHS P30 CA006516NCI NIH HHS R50 CA252138NCI NIH HHS U2C CA233262NCI NIH HHS U54 CA225088
6 · The paper itself

Abstract

Upcoming technologies enable routine collection of highly multiplexed (20-60 channel), subcellular resolution images of mammalian tissues for research and diagnosis. Extracting single cell data from such images requires accurate image segmentation, a challenging problem commonly tackled with deep learning. In this paper, we report two findings that substantially improve image segmentation of tissues using a range of machine learning architectures. First, we unexpectedly find that the inclusion of intentionally defocused and saturated images in training data substantially improves subsequent image segmentation. Such real augmentation outperforms computational augmentation (Gaussian blurring). In addition, we find that it is practical to image the nuclear envelope in multiple tissues using an antibody cocktail thereby better identifying nuclear outlines and improving segmentation. The two approaches cumulatively and substantially improve segmentation on a wide range of tissue types. We speculate that the use of real augmentations will have applications in image processing outside of microscopy.

Indexed as

Deep LearningAnimalsCell NucleusHumansImage Processing, Computer-AssistedMachine LearningMammals

Identifiers

PMID36400937
PMCPMC9674686

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.