Evidence map›Paper›PMID 33142135›Full record

ArticleMedical image analysis2021

Segmentation of cellular patterns in confocal images of melanocytic lesions in vivo via a multiscale encoder-decoder network (MED-Net).

Kivanc Kose, Alican Bozkurt, Christi Alessi-Fox, Melissa Gill, Caterina Longo, Giovanni Pellacani, Jennifer G Dy, Dana H Brooks, Milind Rajadhyaksha

Open access · greenAbstract read
In one paragraph

Article in Medical image analysis, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed
0.5field-weighted citation impact, top 28% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

19 citing papers in PubMed, 4 citations in OpenAlex.

  1. Article
  2. Article
  3. Quantitative assessment ofBiomedical optics express · 2025
    Article
  4. Article
  5. Review
  6. Review
  7. Article
  8. Utilizing deep learning for dermal matrix quality assessment on in vivo line-field confocal optical coherence tomography images.Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging (ISSI) · 2023
    Article
  9. Article
  10. [Exploring and analyzing the improvement mechanism of U-Net and its application in medical image segmentation].Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi · 2022
    Article
  11. Article
  12. Review
  13. Article
  14. Article
  15. Review
  16. Deep Learning in Biomedical Optics.Lasers in surgery and medicine · 2021
    Review
  17. Article
  18. Article
  19. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 5 institutions in 3 countries.

Kivanc KoseDermatology Service, Memorial Sloan Kettering Cancer Center, New York, 11377,NY, USA. Electronic address: kosek@mskcc.org.
Alican BozkurtElectrical and Computer Engineering Department, Northeastern University, Boston, 02115, MA, USA. Electronic address: alican@ece.neu.edu.
Christi Alessi-FoxCaliber Imaging and Diagnostics, Rochester, Rochester, 14623, NY, USA. Electronic address: cmalessi@caliberid.com.
Melissa GillDepartment of Pathology at SUNY Downstate Medical Center, New York, 11203, NY, USA; SkinMedical Research Diagnostics, P.L.L.C., Dobbs Ferry, 10522, NY, USA; Faculty of Medicine and Health Sciences, University of Alcala de Henares, Madrid, Spain. Electronic address: melgill@hotmail.com.
Caterina LongoUniversity of Modena and Reggio Emilia, Reggio Emilia, Italy; Azienda Unità Sanitaria Locale - IRCCS di Reggio Emilia, Centro Oncologico ad Alta Tecnologia Diagnostica-Dermatologia, Reggio Emilia, Italy. Electronic address: longo.caterina@gmail.com.
Giovanni PellacaniUniversity of Modena and Reggio Emilia, Reggio Emilia, Italy. Electronic address: pellacani.giovanni@gmail.com.
Jennifer G DyElectrical and Computer Engineering Department, Northeastern University, Boston, 02115, MA, USA. Electronic address: jdy@ece.neu.edu.
Dana H BrooksElectrical and Computer Engineering Department, Northeastern University, Boston, 02115, MA, USA. Electronic address: brooks@ece.neu.edu.
Milind RajadhyakshaDermatology Service, Memorial Sloan Kettering Cancer Center, New York, 11377,NY, USA. Electronic address: rajadhym@mskcc.org.
Northeastern University · USMemorial Sloan Kettering Cancer Center · USUniversity of Modena and Reggio Emilia · ITCaliber Imaging and Diagnostics (United States) · USSUNY Downstate Health Sciences University · US

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Hongbiao Carl Lekaye · 1985 to 2026
$347.4M
Automated Image Guidance for Diagnosing Skin Cancer With Confocal MicroscopyR01CA199673 · NCI · SLOAN-KETTERING INST CAN RESEARCH · PI DY, JENNIFER G, RAJADHYAKSHA, MILIND · 2015 to 2018
$2.5M
NCI NIH HHS P30 CA008748NCI NIH HHS R01 CA199673
6 · The paper itself

Abstract

In-vivo optical microscopy is advancing into routine clinical practice for non-invasively guiding diagnosis and treatment of cancer and other diseases, and thus beginning to reduce the need for traditional biopsy. However, reading and analysis of the optical microscopic images are generally still qualitative, relying mainly on visual examination. Here we present an automated semantic segmentation method called "Multiscale Encoder-Decoder Network (MED-Net)" that provides pixel-wise labeling into classes of patterns in a quantitative manner. The novelty in our approach is the modeling of textural patterns at multiple scales (magnifications, resolutions). This mimics the traditional procedure for examining pathology images, which routinely starts with low magnification (low resolution, large field of view) followed by closer inspection of suspicious areas with higher magnification (higher resolution, smaller fields of view). We trained and tested our model on non-overlapping partitions of 117 reflectance confocal microscopy (RCM) mosaics of melanocytic lesions, an extensive dataset for this application, collected at four clinics in the US, and two in Italy. With patient-wise cross-validation, we achieved pixel-wise mean sensitivity and specificity of 74% and 92%, respectively, with 0.74 Dice coefficient over six classes. In the scenario, we partitioned the data clinic-wise and tested the generalizability of the model over multiple clinics. In this setting, we achieved pixel-wise mean sensitivity and specificity of 77% and 94%, respectively, with 0.77 Dice coefficient. We compared MED-Net against the state-of-the-art semantic segmentation models and achieved better quantitative segmentation performance. Our results also suggest that, due to its nested multiscale architecture, the MED-Net model annotated RCM mosaics more coherently, avoiding unrealistic-fragmented annotations.

Indexed as

Image Processing, Computer-AssistedNeural Networks, ComputerHumansMicroscopy, ConfocalDermatologyIn vivo segmentationMelanocytic lesionReflectance confocal microscopySemantic segmentation

Identifiers

PMID33142135
PMCPMC7885250
OpenAlexW2997064479

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.