Evidence map›Paper›PMID 37011112›Full record

ArticleJMIR human factors2023

A Visual Analytic Tool (VIADS) to Assist the Hypothesis Generation Process in Clinical Research: Mixed Methods Usability Study.

Xia Jing, Vimla L Patel, James J Cimino, Jay H Shubrook, Yuchun Zhou, Brooke N Draghi, Mytchell A Ernst, Chang Liu, Sonsoles De Lacalle

Abstract read
In one paragraph

Article in JMIR human factors, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Xia JingDepartment of Public Health Sciences, College of Behavioral, Social and Health Sciences, Clemson University, Clemson, SC, United States.ORCID https://orcid.org/0000-0002-1916-4588
Vimla L PatelCognitive Studies in Medicine and Public Health, The New York Academy of Medicine, New York, NY, United States.ORCID https://orcid.org/0000-0003-1656-6642
James J CiminoInformatics Institute, School of Medicine, University of Alabama at Birmingham, Birmingham, AL, United States.ORCID https://orcid.org/0000-0003-4101-1622
Jay H ShubrookPrimary Care Department, College of Osteopathic Medicine, Touro University, Vallejo, CA, United States.ORCID https://orcid.org/0000-0001-5173-2656
Yuchun ZhouDepartment of Educational Studies, The Patton College of Education, Ohio University, Athens, OH, United States.ORCID https://orcid.org/0000-0002-0925-5507
Brooke N DraghiDepartment of Public Health Sciences, College of Behavioral, Social and Health Sciences, Clemson University, Clemson, SC, United States.ORCID https://orcid.org/0000-0002-2108-7382
Mytchell A ErnstDepartment of Public Health Sciences, College of Behavioral, Social and Health Sciences, Clemson University, Clemson, SC, United States.ORCID https://orcid.org/0009-0009-7762-3349
Chang LiuElectrical Engineering and Computer Science, Russ College of Engineering and Technology, Ohio University, Athens, OH, United States.ORCID https://orcid.org/0000-0002-6721-1959
Sonsoles De LacalleHealth Science Program, California State University Channel Islands, Camarillo, CA, United States.ORCID https://orcid.org/0000-0001-9594-698X

Funding

Tissue Structural and Neural Remodeling in Human Sacroiliac JointP20GM121342 · NIGMS · CLEMSON UNIVERSITY · PI Hai Yao · 2018 to 2026
$24.7M
Exploration of the hypothesis-generation process as guided by secondary data analysis in clinical research: Can the process be more efficient?R15LM012941 · NLM · OHIO UNIVERSITY ATHENS · PI JING, XIA · 2018 to 2018
$394k
NIGMS NIH HHS P20 GM121342NLM NIH HHS R15 LM012941
6 · The paper itself

Abstract

backgroundVisualization can be a powerful tool to comprehend data sets, especially when they can be represented via hierarchical structures. Enhanced comprehension can facilitate the development of scientific hypotheses. However, the inclusion of excessive data can make visualizations overwhelming.

objectiveWe developed a visual interactive analytic tool for filtering and summarizing large health data sets coded with hierarchical terminologies (VIADS). In this study, we evaluated the usability of VIADS for visualizing data sets of patient diagnoses and procedures coded in the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM).

methodsWe used mixed methods in the study. A group of 12 clinical researchers participated in the generation of data-driven hypotheses using the same data sets and time frame (a 1-hour training session and a 2-hour study session) utilizing VIADS via the think-aloud protocol. The audio and screen activities were recorded remotely. A modified version of the System Usability Scale (SUS) survey and a brief survey with open-ended questions were administered after the study to assess the usability of VIADS and verify their intense usage experience with VIADS.

resultsThe range of SUS scores was 37.5 to 87.5. The mean SUS score for VIADS was 71.88 (out of a possible 100, SD 14.62), and the median SUS was 75. The participants unanimously agreed that VIADS offers new perspectives on data sets (12/12, 100%), while 75% (8/12) agreed that VIADS facilitates understanding, presentation, and interpretation of underlying data sets. The comments on the utility of VIADS were positive and aligned well with the design objectives of VIADS. The answers to the open-ended questions in the modified SUS provided specific suggestions regarding potential improvements for VIADS, and the identified problems with usability were used to update the tool.

conclusionsThis usability study demonstrates that VIADS is a usable tool for analyzing secondary data sets with good average usability, good SUS score, and favorable utility. Currently, VIADS accepts data sets with hierarchical codes and their corresponding frequencies. Consequently, only specific types of use cases are supported by the analytical results. Participants agreed, however, that VIADS provides new perspectives on data sets and is relatively easy to use. The VIADS functionalities most appreciated by participants were the ability to filter, summarize, compare, and visualize data. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/39414.

Indexed as

clinical researchdata-driven hypothesis generationmixed methods studySUSusabilityVIADSvisualization

Identifiers

PMID37011112
PMCPMC10176142

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.