Evidence map›Paper›PMID 32228880›Full record

ArticleFertility and sterility2020

Consistency and objectivity of automated embryo assessments using deep neural networks.

Charles L Bormann, Prudhvi Thirumalaraju, Manoj Kumar Kanakasabapathy, Hemanth Kandula, Irene Souter, Irene Dimitriadis, Raghav Gupta, Rohan Pooniwala, Hadi Shafiee

Open access · hybridAbstract read
In one paragraph

Article in Fertility and sterility, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 54 papers.

0numbers the graph read from it
0cells of the map it votes in
54citing papers in PubMed
8.1field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

54 citing papers in PubMed, 112 citations in OpenAlex.

  1. Trial
  2. Review
  3. Article
  4. Addressing multiple pregnancies in in vitro fertilization-embryo transfer: Current status, challenges, and solutions.International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics · 2026
    Review
  5. Article
  6. Review
  7. Review
  8. Review
  9. Accurate machine learning model for human embryo morphokinetic stage detection.Journal of assisted reproduction and genetics · 2025
    Article
  10. Article
  11. Article
  12. The Integration of Artificial Intelligence inJournal of pharmacy & bioallied sciences · 2025
    Review
  13. Article
  14. Review
  15. Article
  16. Nature does it better: mimickingFrontiers in veterinary science · 2025
    Review
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

9 authors at 2 institutions in 1 country.

Charles L BormannDivision of Reproductive Endocrinology and Infertility, Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts; Department of Medicine, Harvard Medical School, Boston, Massachusetts.
Prudhvi ThirumalarajuDivision of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts.
Manoj Kumar KanakasabapathyDivision of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts.
Hemanth KandulaDivision of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts.
Irene SouterDivision of Reproductive Endocrinology and Infertility, Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts.
Irene DimitriadisDivision of Reproductive Endocrinology and Infertility, Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts; Department of Medicine, Harvard Medical School, Boston, Massachusetts.
Raghav GuptaDivision of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts.
Rohan PooniwalaDivision of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts.
Hadi ShafieeDivision of Reproductive Endocrinology and Infertility, Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts; Department of Medicine, Harvard Medical School, Boston, Massachusetts. Electronic address: hshafiee@bwh.harvard.edu.
Brigham and Women's Hospital · USHarvard University · US

Funding

Microchip for HBV testing using HIV-infected blood samplesR01AI138800 · NIAID · BRIGHAM AND WOMEN'S HOSPITAL · PI SHAFIEE, HADI · 2019 to 2023
$3.1M
Sensitive and quantitative point-of-care viral load testing on paperR01AI118502 · NIAID · BRIGHAM AND WOMEN'S HOSPITAL · PI SHAFIEE, HADI · 2016 to 2020
$2.2M
NIAID NIH HHS R01 AI118502NIAID NIH HHS R01 AI138800
6 · The paper itself

Abstract

objectiveTo evaluate the consistency and objectivity of deep neural networks in embryo scoring and making disposition decisions for biopsy and cryopreservation in comparison to grading by highly trained embryologists.

designProspective double-blind study using retrospective data.

settingU.S.-based large academic fertility center. PATIENTS: Not applicable. INTERVENTION(S): Embryo images (748 recorded at 70 hours postinsemination [hpi]) and 742 at 113 hpi) were used to evaluate embryologists and neural networks in embryo grading. The performance of 10 embryologists and a neural network were also evaluated in disposition decision making using 56 embryos.

main outcome measuresCoefficients of variation (%CV) and measures of consistencies were compared.

resultsEmbryologists exhibited a high degree of variability (%CV averages: 82.84% for 70 hpi and 44.98% for 113 hpi) in grading embryo. When selecting blastocysts for biopsy or cryopreservation, embryologists had an average consistency of 52.14% and 57.68%, respectively. The neural network outperformed the embryologists in selecting blastocysts for biopsy and cryopreservation with a consistency of 83.92%. Cronbach's α analysis revealed an α coefficient of 0.60 for the embryologists and 1.00 for the network.

conclusionsThe results of our study show a high degree of interembryologist and intraembryologist variability in scoring embryos, likely due to the subjective nature of traditional morphology grading. This may ultimately lead to less precise disposition decisions and discarding of viable embryos. The application of a deep neural network, as shown in our study, can introduce improved reliability and high consistency during the process of embryo selection and disposition, potentially improving outcomes in an embryology laboratory.

Indexed as

Deep LearningNeural Networks, ComputerDouble-Blind MethodEmbryologyEmbryo, MammalianHumansProspective StudiesRetrospective StudiesTime-Lapse ImagingConvolutional neural networksdeep-learningembryo assessmentmachine learning

Identifiers

PMID32228880
PMCPMC7583085
OpenAlexW3013534864

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.