Evidence map›Paper›PMID 22846169›Full record

ArticleJournal of biomedical informatics2013

A human-computer collaborative approach to identifying common data elements in clinical trial eligibility criteria.

Zhihui Luo, Riccardo Miotto, Chunhua Weng

Abstract read
In one paragraph

Article in Journal of biomedical informatics, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Article
  5. The My Cancer Genome clinical trial data model and trial curation workflow.Journal of the American Medical Informatics Association : JAMIA · 2020
    Article
  6. Review
  7. Article
  8. Article
  9. DQueST: dynamic questionnaire for search of clinical trials.Journal of the American Medical Informatics Association : JAMIA · 2019
    Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Article
  16. Article
  17. Trend and Network Analysis of Common Eligibility Features for Cancer Trials in ClinicalTrials.gov.Smart health : international conference, ICSH ... ICSH (Conference : Smart Health) · 2014
    Article
  18. Article
  19. A method for analyzing commonalities in clinical trial target populations.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2014
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Zhihui LuoDepartment of Biomedical Informatics, Columbia University, New York, NY 10032, United States.
Riccardo Miotto
Chunhua Weng

Funding

CTSA INFRASTRUCTURE FOR PEDIATRIC RESEARCHUL1RR024156 · NCRR · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI GINSBERG, HENRY N · 2006 to 2011
$53.0M
Bridging the Semantic Gap Between Research Eligibility Criteria and Clinical DataR01LM009886 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI WENG, CHUNHUA · 2009 to 2020
$5.3M
Developing Flexible EHR Plug-ins to Re-Engineer Clinical Care and Research WorkflowsR01LM010815 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI HOMMA, SHUNICHI, WENG, CHUNHUA · 2010 to 2013
$1.9M
NCRR NIH HHS UL1 RR024156NLM NIH HHS R01 LM009886NLM NIH HHS R01LM009886NLM NIH HHS R01 LM010815NLM NIH HHS R01LM010815
6 · The paper itself

Abstract

objectiveTo identify Common Data Elements (CDEs) in eligibility criteria of multiple clinical trials studying the same disease using a human-computer collaborative approach.

designA set of free-text eligibility criteria from clinical trials on two representative diseases, breast cancer and cardiovascular diseases, was sampled to identify disease-specific eligibility criteria CDEs. In this proposed approach, a semantic annotator is used to recognize Unified Medical Language Systems (UMLSs) terms within the eligibility criteria text. The Apriori algorithm is applied to mine frequent disease-specific UMLS terms, which are then filtered by a list of preferred UMLS semantic types, grouped by similarity based on the Dice coefficient, and, finally, manually reviewed. MEASUREMENTS: Standard precision, recall, and F-score of the CDEs recommended by the proposed approach were measured with respect to manually identified CDEs.

resultsAverage precision and recall of the recommended CDEs for the two diseases were 0.823 and 0.797, respectively, leading to an average F-score of 0.810. In addition, the machine-powered CDEs covered 80% of the cardiovascular CDEs published by The American Heart Association and assigned by human experts.

conclusionIt is feasible and effort saving to use a human-computer collaborative approach to augment domain experts for identifying disease-specific CDEs from free-text clinical trial eligibility criteria.

Indexed as

Clinical Trials as TopicCooperative BehaviorMan-Machine SystemsPatient SelectionAlgorithmsHumansInformation Storage and RetrievalUnified Medical Language System

Identifiers

PMID22846169
PMCPMC3524400

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.