Evidence map›Paper›PMID 25888696›Full record

ReviewBriefings in bioinformatics2016

Crowdsourcing in biomedicine: challenges and opportunities.

Ritu Khare, Benjamin M Good, Robert Leaman, Andrew I Su, Zhiyong Lu

Abstract readReview
In one paragraph

Review in Briefings in bioinformatics, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 44 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
44citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

44 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. A systematic literature review of machine learning in online personal health data.Journal of the American Medical Informatics Association : JAMIA · 2019
    Pooled it
  2. Mapping of Crowdsourcing in Health: Systematic Review.Journal of medical Internet research · 2018
    Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Ritu Khare
Benjamin M Good
Robert Leaman
Andrew I Su
Zhiyong Lu

Funding

Scripps Translational Science InstituteUL1TR001114 · NCATS · SCRIPPS RESEARCH INSTITUTE, THE · PI TOPOL, ERIC JEFFREY · 2013 to 2017
$24.0M
TRAININGU54GM114833 · NIGMS · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI LINDSEY, MERRY L., PING, PEIPEI · 2014 to 2017
$13.8M
Named Entity Recognition and Relationship Extraction in BiomedicineZIALM091813 · NLM · NATIONAL LIBRARY OF MEDICINE · PI LU, ZHIYONG · 2013 to 2022
$13.4M
BioGPS: Extensible Web 2.0 gene portal for structured and unstructured annotationR01GM083924 · NIGMS · SCRIPPS RESEARCH INSTITUTE, THE · PI SU, ANDREW I, WU, CHUNLEI · 2008 to 2021
$5.6M
The Gene Wiki: Community intelligence applied to gene annotationR01GM089820 · NIGMS · SCRIPPS RESEARCH INSTITUTE, THE · PI SU, ANDREW I · 2010 to 2021
$5.2M
NCATS NIH HHS UL1 TR001114NCATS NIH HHS UL1TR001114NIGMS NIH HHS 1U54GM114833NIGMS NIH HHS R01 GM083924NIGMS NIH HHS R01GM083924NIGMS NIH HHS R01 GM089820NIGMS NIH HHS R01GM089820NIGMS NIH HHS U54 GM114833
6 · The paper itself

Abstract

The use of crowdsourcing to solve important but complex problems in biomedical and clinical sciences is growing and encompasses a wide variety of approaches. The crowd is diverse and includes online marketplace workers, health information seekers, science enthusiasts and domain experts. In this article, we review and highlight recent studies that use crowdsourcing to advance biomedicine. We classify these studies into two broad categories: (i) mining big data generated from a crowd (e.g. search logs) and (ii) active crowdsourcing via specific technical platforms, e.g. labor markets, wikis, scientific games and community challenges. Through describing each study in detail, we demonstrate the applicability of different methods in a variety of domains in biomedical research, including genomics, biocuration and clinical research. Furthermore, we discuss and highlight the strengths and limitations of different crowdsourcing platforms. Finally, we identify important emerging trends, opportunities and remaining challenges for future crowdsourcing research in biomedicine.

Indexed as

Computational BiologyCrowdsourcingData MiningHumansInternetSearch EngineSmartphoneSocial MediaVideo GamesAmazon Mechanical Turkbig data miningbiomedicinecommunity challengescrowdsourcinggames

Identifiers

PMID25888696
PMCPMC4719068

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.