Evidence map›Paper›PMID 37338239›Full record

ArticleJournal of chemical information and modeling2023

Characterizing Uncertainty in Machine Learning for Chemistry.

Esther Heid, Charles J McGill, Florence H Vermeire, William H Green

Abstract read
In one paragraph

Article in Journal of chemical information and modeling, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 30 papers.

0numbers the graph read from it
0cells of the map it votes in
30citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

30 citing papers in PubMed.

  1. Review
  2. Review
  3. Article
  4. tmQM-RDF Data Set: A Knowledge Graph Representing Transition Metal Complexes.Journal of chemical information and modeling · 2026
    Article
  5. Article
  6. Article
  7. Article
  8. Uncertainty Quantification forChemical reviews · 2026
    Review
  9. Article
  10. Article
  11. Integrating generative AI and physical tests to strengthen claims about emergent phenomena.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  12. Generative AI for computational chemistry: A roadmap to predicting emergent phenomena.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Esther HeidDepartment of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, United States.ORCID 0000-0002-8404-6596
Charles J McGillDepartment of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, United States.ORCID 0000-0003-2704-7717
Florence H VermeireDepartment of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, United States.
William H GreenDepartment of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, United States.ORCID 0000-0003-2603-9694

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Characterizing uncertainty in machine learning models has recently gained interest in the context of machine learning reliability, robustness, safety, and active learning. Here, we separate the total uncertainty into contributions from noise in the data (aleatoric) and shortcomings of the model (epistemic), further dividing epistemic uncertainty into model bias and variance contributions. We systematically address the influence of noise, model bias, and model variance in the context of chemical property predictions, where the diverse nature of target properties and the vast chemical chemical space give rise to many different distinct sources of prediction error. We demonstrate that different sources of error can each be significant in different contexts and must be individually addressed during model development. Through controlled experiments on data sets of molecular properties, we show important trends in model performance associated with the level of noise in the data set, size of the data set, model architecture, molecule representation, ensemble size, and data set splitting. In particular, we show that 1) noise in the test set can limit a model's observed performance when the actual performance is much better, 2) using size-extensive model aggregation structures is crucial for extensive property prediction, and 3) ensembling is a reliable tool for uncertainty quantification and improvement specifically for the contribution of model variance. We develop general guidelines on how to improve an underperforming model when falling into different uncertainty contexts.

Indexed as

Machine LearningReproducibility of ResultsUncertainty

Identifiers

PMID37338239
PMCPMC10336963

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.