Evidence map›Paper›PMID 34283864›Full record

ArticlePloS one2021

A community-powered search of machine learning strategy space to find NMR property prediction models.

Lars A Bratholm, Will Gerrard, Brandon Anderson, Shaojie Bai, Sunghwan Choi, Lam Dang, Pavel Hanchar, Addison Howard, Sanghoon Kim, Zico Kolter and 17 more

Abstract read
In one paragraph

Article in PloS one, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Real-time prediction ofChemical science · 2021
    Article
  5. Article
  6. Review
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

27 authors.

Lars A BratholmSchool of Chemistry, University of Bristol, Bristol, United Kingdom.ORCID 0000-0002-3565-5926
Will GerrardSchool of Chemistry, University of Bristol, Bristol, United Kingdom.
Brandon AndersonDepartment of Computer Science, The University of Chicago, Chicago, IL, United States of America.
Shaojie BaiBosch Center for Artificial Intelligence, Pittsburgh, PA, United States of America.
Sunghwan ChoiNational Institute of Supercomputing and Network, Korea Institute of Science and Technology Information, Yuseong-gu, Daejeon, Republic of Korea.
Lam DangBNP Paribas Cardif, Nanterre Cedex, France.
Pavel HancharFyusion, Inc., San Francisco, CA, United States of America.
Addison HowardKaggle, Google Inc., Mountain View, CA, United States of America.
Sanghoon KimEbay Korea, Gangnam Gu, Seoul, Republic of Korea.
Zico KolterBosch Center for Artificial Intelligence, Pittsburgh, PA, United States of America.
Risi KondorDepartment of Computer Science, The University of Chicago, Chicago, IL, United States of America.
Mordechai KornbluthBosch Research and Technology Center, Cambridge, MA, United States of America.ORCID 0000-0001-6705-8133
Youhan LeeDepartment of Chemical and Biomolecular Engineering, Korea Advanced Institute of Science and Technology, Yuseong-gu, Daejeon, Republic of Korea.
Youngsoo LeeMINDS AND COMPANY, Gangnam-gu, Seoul, Republic of Korea.
Jonathan P MailoaBosch Research and Technology Center, Cambridge, MA, United States of America.
Thanh Tu NguyenBNP Paribas Cardif, Nanterre Cedex, France.
Milos PopovicTotient Inc, Belgrade, Serbia.
Goran RakocevicTotient Inc, Belgrade, Serbia.ORCID 0000-0002-3411-0764
Walter ReadeKaggle, Google Inc., Mountain View, CA, United States of America.
Wonho SongKAIST Web Security & Privacy Lab, Yuseong-gu, Daejeon, Republic of Korea.
Luka StojanovicTotient Inc, Belgrade, Serbia.
Erik H ThiedeDepartment of Computer Science, The University of Chicago, Chicago, IL, United States of America.
Nebojsa TijanicTotient Inc, Belgrade, Serbia.
Andres TorrubiaMedbravo.org, Alicante, Spain.
Devin WillmottBosch Center for Artificial Intelligence, Pittsburgh, PA, United States of America.
Craig P ButtsSchool of Chemistry, University of Bristol, Bristol, United Kingdom.
David R GlowackiSchool of Chemistry, University of Bristol, Bristol, United Kingdom.ORCID 0000-0002-9608-3845

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

The rise of machine learning (ML) has created an explosion in the potential strategies for using data to make scientific predictions. For physical scientists wishing to apply ML strategies to a particular domain, it can be difficult to assess in advance what strategy to adopt within a vast space of possibilities. Here we outline the results of an online community-powered effort to swarm search the space of ML strategies and develop algorithms for predicting atomic-pairwise nuclear magnetic resonance (NMR) properties in molecules. Using an open-source dataset, we worked with Kaggle to design and host a 3-month competition which received 47,800 ML model predictions from 2,700 teams in 84 countries. Within 3 weeks, the Kaggle community produced models with comparable accuracy to our best previously published 'in-house' efforts. A meta-ensemble model constructed as a linear combination of the top predictions has a prediction accuracy which exceeds that of any individual model, 7-19x better than our previous state-of-the-art. The results highlight the potential of transformer architectures for predicting quantum mechanical (QM) molecular properties.

Indexed as

AlgorithmsCitizen ScienceCommunity ParticipationForecastingHumansMachine LearningMagnetic Resonance ImagingMagnetic Resonance SpectroscopyModels, Statistical

Identifiers

PMID34283864
PMCPMC8291653

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.