ArticleJournal of the American Medical Informatics Association : JAMIA
Development and evaluation of a crowdsourcing methodology for knowledge base construction: identifying relationships between clinical problems and medications.
Article in Journal of the American Medical Informatics Association : JAMIA. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 26 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
26 citing papers in PubMed, 2 syntheses or guidelines pooled it.
- Mapping of Crowdsourcing in Health: Systematic Review.Journal of medical Internet research · 2018Pooled it
- Medication-indication knowledge bases: a systematic review and critical appraisal.Journal of the American Medical Informatics Association : JAMIA · 2015Pooled it
- Crowdsourced human-based computational approach for tagging peripheral blood smear sample images from Sickle Cell Disease patients using non-expert users.Scientific reports · 2024Article
- An updated, computable MEDication-Indication resource for biomedical research.Scientific reports · 2021Article
- Overcoming Barriers to Parkinson Disease Trial Participation: Increasing Diversity and Novel Designs for Recruitment and Retention.Neurotherapeutics : the journal of the American Society for Experimental NeuroTherapeutics · 2020Review
- Automated assessment of biological database assertions using the scientific literature.BMC bioinformatics · 2019Article
- A Decade of Translational Bioinformatics: A Retrospective Analysis of "Year-in-Review" Presentations.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2019Article
- OC-2-KB: integrating crowdsourcing into an obesity and cancer knowledge base curation system.BMC medical informatics and decision making · 2018Article
- Article
- Determinants of a successful problem list to support the implementation of the problem-oriented medical record according to recent literature.BMC medical informatics and decision making · 2016Review
- Disease-drug database for pharmacogenomic-based prescribing.Clinical pharmacology and therapeutics · 2016Article
- Using Nonexperts for Annotating Pharmacokinetic Drug-Drug Interaction Mentions in Product Labeling: A Feasibility Study.JMIR research protocols · 2016Article
- Crowdsourcing in biomedicine: challenges and opportunities.Briefings in bioinformatics · 2016Review
- Novel user interface design for medication reconciliation: an evaluation of Twinlist.Journal of the American Medical Informatics Association : JAMIA · 2015Article
- Validation of a Crowdsourcing Methodology for Developing a Knowledge Base of Related Problem-Medication Pairs.Applied clinical informatics · 2015Article
- Scaling drug indication curation through crowdsourcing.Database : the journal of biological databases and curation · 2015Article
- LabeledIn: cataloging labeled indications for human drugs.Journal of biomedical informatics · 2014Article
- Development of a clinician reputation metric to identify appropriate problem-medication pairs in a crowdsourced knowledge base.Journal of biomedical informatics · 2014Article
- Decision support from local data: creating adaptive order menus from past clinician behavior.Journal of biomedical informatics · 2014Article
- Clinical decision support alert appropriateness: a review and proposal for improvement.Ochsner journal · 2014Review
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
7 authors.
Funding
Abstract
objectiveWe describe a novel, crowdsourcing method for generating a knowledge base of problem-medication pairs that takes advantage of manually asserted links between medications and problems.
methodsThrough iterative review, we developed metrics to estimate the appropriateness of manually entered problem-medication links for inclusion in a knowledge base that can be used to infer previously unasserted links between problems and medications.
resultsClinicians manually linked 231,223 medications (55.30% of prescribed medications) to problems within the electronic health record, generating 41,203 distinct problem-medication pairs, although not all were accurate. We developed methods to evaluate the accuracy of the pairs, and after limiting the pairs to those meeting an estimated 95% appropriateness threshold, 11,166 pairs remained. The pairs in the knowledge base accounted for 183,127 total links asserted (76.47% of all links). Retrospective application of the knowledge base linked 68,316 medications not previously linked by a clinician to an indicated problem (36.53% of unlinked medications). Expert review of the combined knowledge base, including inferred and manually linked problem-medication pairs, found a sensitivity of 65.8% and a specificity of 97.9%.
conclusionCrowdsourcing is an effective, inexpensive method for generating a knowledge base of problem-medication pairs that is automatically mapped to local terminologies, up-to-date, and reflective of local prescribing practices and trends.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.