Evidence map›Paper›PMID 26940748›Full record

ArticleMethods of information in medicine2016

Valx: A System for Extracting and Structuring Numeric Lab Test Comparison Statements from Text.

Tianyong Hao, Hongfang Liu, Chunhua Weng

Abstract read
In one paragraph

Article in Methods of information in medicine, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Parsing Clinical Trial Eligibility Criteria for Cohort Query by a Multi-Input Multi-Output Sequence Labeling Model.Proceedings. IEEE International Conference on Bioinformatics and Biomedicine · 2023
    Article
  4. Combining human and machine intelligence for clinical trial eligibility querying.Journal of the American Medical Informatics Association : JAMIA · 2022
    Article
  5. Article
  6. Transformer-Based Named Entity Recognition for Parsing Clinical Trial Eligibility Criteria.ACM-BCB ... ... : the ... ACM Conference on Bioinformatics, Computational Biology and Biomedicine. ACM Conference on Bioinformatics, Computational Biology and Biomedicine · 2021
    Article
  7. Article
  8. Article
  9. Article
  10. DQueST: dynamic questionnaire for search of clinical trials.Journal of the American Medical Informatics Association : JAMIA · 2019
    Article
  11. Quantifying risk factors in medical reports with a context-aware linear model.Journal of the American Medical Informatics Association : JAMIA · 2019
    Article
  12. Criteria2Query: a natural language interface to clinical databases for cohort definition.Journal of the American Medical Informatics Association : JAMIA · 2019
    Article
  13. Comparing the Study Populations in Dietary Supplement and Drug Clinical Trials for Metabolic Syndrome and Related Disorders.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2019
    Article
  14. A bibliometric analysis of natural language processing in medical research.BMC medical informatics and decision making · 2018
    Article
  15. Article
  16. The representativeness of eligible patients in type 2 diabetes trials: a case study using GIST 2.0.Journal of the American Medical Informatics Association : JAMIA · 2018
    Article
  17. Review
  18. EliIE: An open-source information extraction system for clinical trial eligibility criteria.Journal of the American Medical Informatics Association : JAMIA · 2017
    Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Tianyong Hao
Hongfang Liu
Chunhua WengChunhua Weng, Ph.D., Department of Biomedical Informatics, Columbia University, New York City, 622 W 168th Street, PH-20, New York, NY 10032, USA, E-mail: chunhua@columbia.edu.

Funding

Clinical and Translational Science AwardUL1TR000040 · NCATS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI GINSBERG, HENRY N · 2012 to 2015
$26.2M
Bridging the Semantic Gap Between Research Eligibility Criteria and Clinical DataR01LM009886 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI WENG, CHUNHUA · 2009 to 2020
$5.3M
Natural language processing for clinical and translational researchR01GM102282 · NIGMS · MAYO CLINIC ROCHESTER · PI LIU, HONGFANG, PAKHOMOV, SERGUEI VS · 2013 to 2016
$2.5M
NCATS NIH HHS UL1 TR000040NIGMS NIH HHS R01 GM102282NLM NIH HHS R01 LM009886
6 · The paper itself

Abstract

objectivesTo develop an automated method for extracting and structuring numeric lab test comparison statements from text and evaluate the method using clinical trial eligibility criteria text.

methodsLeveraging semantic knowledge from the Unified Medical Language System (UMLS) and domain knowledge acquired from the Internet, Valx takes seven steps to extract and normalize numeric lab test expressions: 1) text preprocessing, 2) numeric, unit, and comparison operator extraction, 3) variable identification using hybrid knowledge, 4) variable - numeric association, 5) context-based association filtering, 6) measurement unit normalization, and 7) heuristic rule-based comparison statements verification. Our reference standard was the consensus-based annotation among three raters for all comparison statements for two variables, i.e., HbA1c and glucose, identified from all of Type 1 and Type 2 diabetes trials in ClinicalTrials.gov.

resultsThe precision, recall, and F-measure for structuring HbA1c comparison statements were 99.6%, 98.1%, 98.8% for Type 1 diabetes trials, and 98.8%, 96.9%, 97.8% for Type 2 diabetes trials, respectively. The precision, recall, and F-measure for structuring glucose comparison statements were 97.3%, 94.8%, 96.1% for Type 1 diabetes trials, and 92.3%, 92.3%, 92.3% for Type 2 diabetes trials, respectively.

conclusionsValx is effective at extracting and structuring free-text lab test comparison statements in clinical trial summaries. Future studies are warranted to test its generalizability beyond eligibility criteria text. The open-source Valx enables its further evaluation and continued improvement among the collaborative scientific community.

Indexed as

AlgorithmsData MiningNumerical Analysis, Computer-AssistedDiabetes Mellitus, Type 1Diabetes Mellitus, Type 2Glycated HemoglobinHumansUser-Computer InterfaceGlycated Hemoglobinclinical trialcomparison statementMedical informaticsnatural language processingpatient selection

Identifiers

PMID26940748
PMCPMC5573874

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.