Evidence map›Paper›PMID 31247029›Full record

ArticlePLoS computational biology2019

EternaBrain: Automated RNA design through move sets and strategies from an Internet-scale RNA videogame.

Rohan V Koodli, Benjamin Keep, Katherine R Coppess, Fernando Portela, Eterna participants, Rhiju Das

Abstract read
In one paragraph

Article in PLoS computational biology, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed.

  1. Review
  2. Article
  3. JAX-RNAfold: scalable differentiable folding.Bioinformatics (Oxford, England) · 2025
    Article
  4. Review
  5. Article
  6. Machine Learning for RNA Design: LEARNA.Methods in molecular biology (Clifton, N.J.) · 2025
    Article
  7. Article
  8. Authorship and Citizen Science: Seven Heuristic Rules.Science and engineering ethics · 2024
    Article
  9. Article
  10. Fitness functions for RNA structure design.Nucleic acids research · 2023
    Article
  11. Article
  12. Article
  13. Article
  14. RNA Engineering for Public Health: Innovations in RNA-Based Diagnostics and Therapeutics.Annual review of chemical and biomolecular engineering · 2021
    Article
  15. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Rohan V KoodliDepartment of Biochemistry, Stanford University School of Medicine, Stanford, CA, United States of America.
Benjamin KeepDepartment of Education, Stanford University, Stanford, CA, United States of America.ORCID 0000-0002-0570-5515
Katherine R CoppessDepartment of Physics, Stanford University, Stanford, CA, United States of America.
Fernando PortelaDepartment of Biochemistry, Stanford University School of Medicine, Stanford, CA, United States of America.ORCID 0000-0003-0238-9251
Eterna participants
Rhiju DasDepartment of Biochemistry, Stanford University School of Medicine, Stanford, CA, United States of America.ORCID 0000-0001-7497-0972

Funding

Next-generation computational/chemical methods for complex RNA structuresR35GM122579 · NIGMS · STANFORD UNIVERSITY · PI Rhiju Das · 2017 to 2026
$7.2M
Internet-scale discovery of RNA bioengineering rulesR01GM100953 · NIGMS · STANFORD UNIVERSITY · PI DAS, RHIJU · 2012 to 2015
$1.8M
NIGMS NIH HHS R01 GM100953NIGMS NIH HHS R35 GM122579
6 · The paper itself

Abstract

Emerging RNA-based approaches to disease detection and gene therapy require RNA sequences that fold into specific base-pairing patterns, but computational algorithms generally remain inadequate for these secondary structure design tasks. The Eterna project has crowdsourced RNA design to human video game players in the form of puzzles that reach extraordinary difficulty. Here, we demonstrate that Eterna participants' moves and strategies can be leveraged to improve automated computational RNA design. We present an eternamoves-large repository consisting of 1.8 million of player moves on 12 of the most-played Eterna puzzles as well as an eternamoves-select repository of 30,477 moves from the top 72 players on a select set of more advanced puzzles. On eternamoves-select, we present a multilayer convolutional neural network (CNN) EternaBrain that achieves test accuracies of 51% and 34% in base prediction and location prediction, respectively, suggesting that top players' moves are partially stereotyped. Pipelining this CNN's move predictions with single-action-playout (SAP) of six strategies compiled by human players solves 61 out of 100 independent puzzles in the Eterna100 benchmark. EternaBrain-SAP outperforms previously published RNA design algorithms and achieves similar or better performance than a newer generation of deep learning methods, while being largely orthogonal to these other methods. Our study provides useful lessons for future efforts to achieve human-competitive performance with automated RNA design algorithms.

Indexed as

InternetNeural Networks, ComputerNucleic Acid ConformationRNAVideo GamesAlgorithmsCrowdsourcingGenetic EngineeringHumansSequence Analysis, RNARNA

Identifiers

PMID31247029
PMCPMC6597038

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.