Evidence map›Paper›PMID 29888047›Full record

ArticleAMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science2018

Usability Evaluation of an Unstructured Clinical Document Query Tool for Researchers.

Gretchen Hultman, Reed McEwan, Serguei Pakhomov, Elizabeth Lindemann, Steven Skube, Genevieve B Melton

Abstract read
In one paragraph

Article in AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Translational NLP: A New Paradigm and General Principles for Natural Language Processing Research.Proceedings of the conference. Association for Computational Linguistics. North American Chapter. Meeting · 2021
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Gretchen HultmanInstitute for Health Informatics.
Reed McEwanAcademic Health Center - Information Systems.
Serguei PakhomovCollege of Pharmacy.
Elizabeth LindemannDepartment of Surgery, University of Minnesota, Minneapolis, Minnesota.
Steven SkubeDepartment of Surgery, University of Minnesota, Minneapolis, Minnesota.
Genevieve B MeltonInstitute for Health Informatics.

Funding

University of Minnesota Clinical and Translational Science Institute (UMN CTSI)UL1TR000114 · NCATS · UNIVERSITY OF MINNESOTA · PI BLAZAR, BRUCE R · 2012 to 2015
$35.0M
Natural language processing for clinical and translational researchR01GM102282 · NIGMS · MAYO CLINIC ROCHESTER · PI LIU, HONGFANG, PAKHOMOV, SERGUEI VS · 2013 to 2016
$2.5M
Discovery and Visualization of New Information from Clinical Reports in the EHRR01HS022085 · AHRQ · UNIVERSITY OF MINNESOTA · PI MELTON-MEAUX, GENEVIEVE B · 2013 to 2016
$1.9M
Leveraging the EHR to Collect and Analyze Social, Behavioral & Familial FactorsR01LM011364 · NLM · UNIVERSITY OF VERMONT & ST AGRIC COLLEGE · PI CHEN, ELIZABETH S., MELTON-MEAUX, GENEVIEVE B · 2012 to 2015
$1.4M
AHRQ HHS R01 HS022085NCATS NIH HHS UL1 TR000114NIGMS NIH HHS R01 GM102282NLM NIH HHS R01 LM011364
6 · The paper itself

Abstract

Natural Language Processing - Patient Information Extraction for Researchers (NLP-PIER) was developed for clinical researchers for self-service Natural Language Processing (NLP) queries with clinical notes. This study was to conduct a user-centered analysis with clinical researchers to gain insight into NLP-PIER's usability and to gain an understanding of the needs of clinical researchers when using an application for searching clinical notes. Clinical researcher participants (n=11) completed tasks using the system's two existing search interfaces and completed a set of surveys and an exit interview. Quantitative data including time on task, task completion rate, and survey responses were collected. Interviews were analyzed qualitatively. Survey scores, time on task and task completion proportions varied widely. Qualitative analysis indicated that participants found the system to be useful and usable in specific projects. This study identified several usability challenges and our findings will guide the improvement of NLP-PIER 's interfaces.

Identifiers

PMID29888047
PMCPMC5961783

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.