Evidence map›Paper›PMID 30125267›Full record

ArticleNature biotechnology2018

Deep learning is combined with massive-scale citizen science to improve large-scale image classification.

Devin P Sullivan, Casper F Winsnes, Lovisa Åkesson, Martin Hjelmare, Mikaela Wiking, Rutger Schutten, Linzi Campbell, Hjalti Leifsson, Scott Rhodes, Andie Nordgren and 5 more

Abstract read
PubMed Publisher
In one paragraph

Article in Nature biotechnology, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 69 papers.

0numbers the graph read from it
0cells of the map it votes in
69citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

69 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Article
  5. Article
  6. Machine learning in healthcare citizen science: A scoping review.International journal of medical informatics · 2025
    Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Unbiased single-cell morphology with self-supervised vision transformers.bioRxiv : the preprint server for biology · 2023
    Article
  15. Article
  16. Article
  17. Self-Curable Synaptic Ferroelectric FET Arrays for Neuromorphic Convolutional Neural Network.Advanced science (Weinheim, Baden-Wurttemberg, Germany) · 2023
    Article
  18. Article
  19. Article
  20. Machine learning enhanced cell tracking.Frontiers in bioinformatics · 2023
    Article

9 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Devin P SullivanScience for Life Laboratory, School of Engineering Sciences in Chemistry, Biotechnology and Health, KTH - Royal Institute of Technology, Stockholm, Sweden.ORCID 0000-0001-6176-108X
Casper F WinsnesScience for Life Laboratory, School of Engineering Sciences in Chemistry, Biotechnology and Health, KTH - Royal Institute of Technology, Stockholm, Sweden.ORCID 0000-0002-0028-5865
Lovisa ÅkessonScience for Life Laboratory, School of Engineering Sciences in Chemistry, Biotechnology and Health, KTH - Royal Institute of Technology, Stockholm, Sweden.
Martin HjelmareScience for Life Laboratory, School of Engineering Sciences in Chemistry, Biotechnology and Health, KTH - Royal Institute of Technology, Stockholm, Sweden.
Mikaela WikingScience for Life Laboratory, School of Engineering Sciences in Chemistry, Biotechnology and Health, KTH - Royal Institute of Technology, Stockholm, Sweden.
Rutger SchuttenScience for Life Laboratory, School of Engineering Sciences in Chemistry, Biotechnology and Health, KTH - Royal Institute of Technology, Stockholm, Sweden.
Linzi CampbellCCP hf, Reyjkavik, Iceland.
Hjalti LeifssonCCP hf, Reyjkavik, Iceland.
Scott RhodesCCP hf, Reyjkavik, Iceland.
Andie NordgrenCCP hf, Reyjkavik, Iceland.
Kevin SmithScience for Life Laboratory, School of Computer Science and Communication, KTH - Royal Institute of Technology, Stockholm, Sweden.
Bernard RevazMMOS Sàrl, Monthey, Switzerland.
Bergur FinnbogasonCCP hf, Reyjkavik, Iceland.
Attila SzantnerMMOS Sàrl, Monthey, Switzerland.
Emma LundbergScience for Life Laboratory, School of Engineering Sciences in Chemistry, Biotechnology and Health, KTH - Royal Institute of Technology, Stockholm, Sweden.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Pattern recognition and classification of images are key challenges throughout the life sciences. We combined two approaches for large-scale classification of fluorescence microscopy images. First, using the publicly available data set from the Cell Atlas of the Human Protein Atlas (HPA), we integrated an image-classification task into a mainstream video game (EVE Online) as a mini-game, named Project Discovery. Participation by 322,006 gamers over 1 year provided nearly 33 million classifications of subcellular localization patterns, including patterns that were not previously annotated by the HPA. Second, we used deep learning to build an automated Localization Cellular Annotation Tool (Loc-CAT). This tool classifies proteins into 29 subcellular localization patterns and can deal efficiently with multi-localization proteins, performing robustly across different cell types. Combining the annotations of gamers and deep learning, we applied transfer learning to create a boosted learner that can characterize subcellular protein distribution with F1 score of 0.72. We found that engaging players of commercial computer games provided data that augmented deep learning and enabled scalable and readily improved image classification.

Indexed as

Deep LearningHumansImage Processing, Computer-AssistedMicroscopy, FluorescenceSubcellular Fractions

Identifiers

PMID30125267

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.