Evidence map›Paper›PMID 36836451›Full record

ArticleJournal of personalized medicine2023

Enhancing Clinical Data Analysis by Explaining Interaction Effects between Covariates in Deep Neural Network Models.

Yijun Shao, Ali Ahmed, Edward Y Zamrini, Yan Cheng, Joseph L Goulet, Qing Zeng-Treitler

Abstract read
In one paragraph

Article in Journal of personalized medicine, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Yijun ShaoDepartment of Clinical Research and Leadership, School of Medicine and Health Sciences, George Washington University, Washington, DC 20037, USA.
Ali AhmedDepartment of Clinical Research and Leadership, School of Medicine and Health Sciences, George Washington University, Washington, DC 20037, USA.ORCID 0000-0002-6832-6424
Edward Y ZamriniDepartment of Clinical Research and Leadership, School of Medicine and Health Sciences, George Washington University, Washington, DC 20037, USA.
Yan ChengDepartment of Clinical Research and Leadership, School of Medicine and Health Sciences, George Washington University, Washington, DC 20037, USA.ORCID 0000-0001-7189-3991
Joseph L GouletVA Connecticut Healthcare System, New Haven, CT 06516, USA.
Qing Zeng-TreitlerDepartment of Clinical Research and Leadership, School of Medicine and Health Sciences, George Washington University, Washington, DC 20037, USA.ORCID 0000-0002-8353-7473

Funding

Clinical and Translational Science Institute at Childrens NationalUL1TR001876 · NCATS · CHILDREN'S RESEARCH INSTITUTE · PI BELL, MICHAEL J · 2016 to 2021
$25.6M
Use Explainable AI to Improve the Trust of and Detect the Bias of AI ModelsRF1AG069121 · NIA · GEORGE WASHINGTON UNIVERSITY · PI KOKKINOS, PETER F., ZAMRINI, EDWARD Y · 2020 to 2022
$2.3M
NIH HHS 1RF1AG069121-01NIH HHS 1UL1TR001876-01United States Department of Veterans Affairs I01 HX001145-02
6 · The paper itself

Abstract

Deep neural network (DNN) is a powerful technology that is being utilized by a growing number and range of research projects, including disease risk prediction models. One of the key strengths of DNN is its ability to model non-linear relationships, which include covariate interactions. We developed a novel method called interaction scores for measuring the covariate interactions captured by DNN models. As the method is model-agnostic, it can also be applied to other types of machine learning models. It is designed to be a generalization of the coefficient of the interaction term in a logistic regression; hence, its values are easily interpretable. The interaction score can be calculated at both an individual level and population level. The individual-level score provides an individualized explanation for covariate interactions. We applied this method to two simulated datasets and a real-world clinical dataset on Alzheimer's disease and related dementia (ADRD). We also applied two existing interaction measurement methods to those datasets for comparison. The results on the simulated datasets showed that the interaction score method can explain the underlying interaction effects, there are strong correlations between the population-level interaction scores and the ground truth values, and the individual-level interaction scores vary when the interaction was designed to be non-uniform. Another validation of our new method is that the interactions discovered from the ADRD data included both known and novel relationships.

Indexed as

Alzheimer’s disease and related dementiadeep learningrisk analysis

Identifiers

PMID36836451
PMCPMC9967882

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.