Evidence map›Paper›PMID 21689783›Full record

ArticleJournal of biomedical informatics2011

Dynamic categorization of clinical research eligibility criteria by hierarchical clustering.

Zhihui Luo, Meliha Yetisgen-Yildiz, Chunhua Weng

Abstract read
In one paragraph

Article in Journal of biomedical informatics, 2011. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 26 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
26citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

26 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. [Artificial intelligence based Chinese clinical trials eligibility criteria classification].Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi · 2021
    Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Automatic data source identification for clinical trial eligibility criteria resolution.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2016
    Article
  15. Article
  16. Article
  17. SimQ: real-time retrieval of similar consumer health questions.Journal of medical Internet research · 2015
    Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Zhihui LuoDepartment of Biomedical Informatics, Columbia University, New York, NY 10032, United States.
Meliha Yetisgen-Yildiz
Chunhua Weng

Funding

CTSA INFRASTRUCTURE FOR PEDIATRIC RESEARCHUL1RR024156 · NCRR · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI GINSBERG, HENRY N · 2006 to 2011
$53.0M
Washington Heights Initiative Community-based Comparative Effectiveness ResearchR01HS019853 · AHRQ · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI BAKKEN, SUZANNE · 2010 to 2010
$8.9M
Bridging the Semantic Gap Between Research Eligibility Criteria and Clinical DataR01LM009886 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI WENG, CHUNHUA · 2009 to 2020
$5.3M
Developing Flexible EHR Plug-ins to Re-Engineer Clinical Care and Research WorkflowsR01LM010815 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI HOMMA, SHUNICHI, WENG, CHUNHUA · 2010 to 2013
$1.9M
AHRQ HHS R01 HS019853NCRR NIH HHS UL1 RR024156NLM NIH HHS R01 LM009886NLM NIH HHS R01LM009886NLM NIH HHS R01 LM010815NLM NIH HHS R01LM010815
6 · The paper itself

Abstract

objectiveTo semi-automatically induce semantic categories of eligibility criteria from text and to automatically classify eligibility criteria based on their semantic similarity.

designThe UMLS semantic types and a set of previously developed semantic preference rules were utilized to create an unambiguous semantic feature representation to induce eligibility criteria categories through hierarchical clustering and to train supervised classifiers. MEASUREMENTS: We induced 27 categories and measured the prevalence of the categories in 27,278 eligibility criteria from 1578 clinical trials and compared the classification performance (i.e., precision, recall, and F1-score) between the UMLS-based feature representation and the "bag of words" feature representation among five common classifiers in Weka, including J48, Bayesian Network, Naïve Bayesian, Nearest Neighbor, and instance-based learning classifier.

resultsThe UMLS semantic feature representation outperforms the "bag of words" feature representation in 89% of the criteria categories. Using the semantically induced categories, machine-learning classifiers required only 2000 instances to stabilize classification performance. The J48 classifier yielded the best F1-score and the Bayesian Network classifier achieved the best learning efficiency.

conclusionThe UMLS is an effective knowledge source and can enable an efficient feature representation for semi-automated semantic category induction and automatic categorization for clinical research eligibility criteria and possibly other clinical text.

Indexed as

Biomedical ResearchCluster AnalysisAlgorithmsArtificial IntelligenceSemanticsUnified Medical Language System

Identifiers

PMID21689783
PMCPMC3183114

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.