Evidence map›Paper›PMID 31390010›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2019

DQueST: dynamic questionnaire for search of clinical trials.

Cong Liu, Chi Yuan, Alex M Butler, Richard D Carvajal, Ziran Ryan Li, Casey N Ta, Chunhua Weng

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Article
  2. Article
  3. Automating Clinical Trial Matches Via Natural Language Processing of Synthetic Electronic Health Records and Clinical Trial Eligibility Criteria.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2024
    Article
  4. Review
  5. Text Classification of Cancer Clinical Trial Eligibility Criteria.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2023
    Article
  6. Article
  7. Review
  8. A knowledge base of clinical trial eligibility criteria.Journal of biomedical informatics · 2021
    Article
  9. The COVID-19 Trial Finder.Journal of the American Medical Informatics Association : JAMIA · 2021
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Cong LiuDepartment of Biomedical Informatics, Columbia University, New York, New York, USA.
Chi YuanDepartment of Biomedical Informatics, Columbia University, New York, New York, USA.
Alex M ButlerDepartment of Biomedical Informatics, Columbia University, New York, New York, USA.
Richard D CarvajalDepartment of Medicine, Columbia University, New York, New York, USA.
Ziran Ryan LiDepartment of Biomedical Informatics, Columbia University, New York, New York, USA.
Casey N TaDepartment of Biomedical Informatics, Columbia University, New York, New York, USA.
Chunhua WengDepartment of Biomedical Informatics, Columbia University, New York, New York, USA.

Funding

Clinical and Translational Science AwardUL1TR001873 · NCATS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI REILLY, MUREDACH P · 2016 to 2025
$99.0M
Bridging the Semantic Gap Between Research Eligibility Criteria and Clinical DataR01LM009886 · NLM · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI WENG, CHUNHUA · 2009 to 2020
$5.3M
SHORT-TERM TRAINING: STUDENTS IN PROFESSIONAL SCHOOLST35HL007616 · NHLBI · COLUMBIA UNIV NEW YORK MORNINGSIDE · PI RUDOLPH L LEIBEL, Markus Y Mapara · 1985 to 2026
$4.4M
NCATS NIH HHS UL1 TR001873NHLBI NIH HHS T35 HL007616NLM NIH HHS R01 LM009886
6 · The paper itself

Abstract

objectiveInformation overload remains a challenge for patients seeking clinical trials. We present a novel system (DQueST) that reduces information overload for trial seekers using dynamic questionnaires. MATERIALS AND

methodsDQueST first performs information extraction and criteria library curation. DQueST transforms criteria narratives in the ClinicalTrials.gov repository into a structured format, normalizes clinical entities using standard concepts, clusters related criteria, and stores the resulting curated library. DQueST then implements a real-time dynamic question generation algorithm. During user interaction, the initial search is similar to a standard search engine, and then DQueST performs real-time dynamic question generation to select criteria from the library 1 at a time by maximizing its relevance score that reflects its ability to rule out ineligible trials. DQueST dynamically updates the remaining trial set by removing ineligible trials based on user responses to corresponding questions. The process iterates until users decide to stop and begin manually reviewing the remaining trials.

resultsIn simulation experiments initiated by 10 diseases, DQueST reduced information overload by filtering out 60%-80% of initial trials after 50 questions. Reviewing the generated questions against previous answers, on average, 79.7% of the questions were relevant to the queried conditions. By examining the eligibility of random samples of trials ruled out by DQueST, we estimate the accuracy of the filtering procedure is 63.7%. In a study using 5 mock patient profiles, DQueST on average retrieved trials with a 1.465 times higher density of eligible trials than an existing search engine. In a patient-centered usability evaluation, patients found DQueST useful, easy to use, and returning relevant results.

conclusionDQueST contributes a novel framework for transforming free-text eligibility criteria to questions and filtering out clinical trials based on user answers to questions dynamically. It promises to augment keyword-based methods to improve clinical trial search.

Indexed as

Clinical Trials as TopicSearch EngineSurveys and QuestionnairesDatabases, FactualHumansInformation Storage and RetrievalMental ProcessesNatural Language Processingclinical trial searchcommon data modeleligibility criteriainteractive searchnatural language processing

Identifiers

PMID31390010
PMCPMC6798577

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.