Evidence map›Paper›PMID 34093095›Full record

ArticleAn international journal on information fusion2021

Pay attention to doctor-patient dialogues: Multi-modal knowledge graph attention image-text embedding for COVID-19 diagnosis.

Wenbo Zheng, Lan Yan, Chao Gou, Zhi-Cheng Zhang, Jun Jason Zhang, Ming Hu, Fei-Yue Wang

Open access · greenAbstract read
In one paragraph

Article in An international journal on information fusion, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
6.9field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 61 citations in OpenAlex.

  1. Review
  2. Multimodal Wearable Biosensing Meets Multidomain AI: A Pathway to Decentralized Healthcare.Advanced science (Weinheim, Baden-Wurttemberg, Germany) · 2026
    Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Knowledge-Based Recurrent Neural Network for TCM Cerebral Palsy Diagnosis.Evidence-based complementary and alternative medicine : eCAM · 2022
    Article
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 4 institutions in 1 country.

Wenbo ZhengSchool of Software Engineering, Xi'an Jiaotong University, Xi'an 710049, China.
Lan YanState Key Laboratory for Management and Control of Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.
Chao GouSchool of Intelligent Systems Engineering, Sun Yat-sen University, Guangzhou 510275, China.
Zhi-Cheng ZhangSeventh Medical Center, General Hospital of People's Liberation Army, Beijing 100700, China.
Jun Jason ZhangSchool of Electrical Engineering and Automation, Wuhan University, Wuhan 430072, China.
Ming HuIntensive Care Unit, Wuhan Pulmonary Hospital, Wuhan 430030, China.
Fei-Yue WangState Key Laboratory for Management and Control of Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.
Chinese Academy of Sciences · CNSun Yat-sen University · CNWuhan Pulmonary Hospital · CNWuhan University · CN

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

The sudden increase in coronavirus disease 2019 (COVID-19) cases puts high pressure on healthcare services worldwide. At this stage, fast, accurate, and early clinical assessment of the disease severity is vital. In general, there are two issues to overcome: (1) Current deep learning-based works suffer from multimodal data adequacy issues; (2) In this scenario, multimodal (e.g., text, image) information should be taken into account together to make accurate inferences. To address these challenges, we propose a multi-modal knowledge graph attention embedding for COVID-19 diagnosis. Our method not only learns the relational embedding from nodes in a constituted knowledge graph but also has access to medical knowledge, aiming at improving the performance of the classifier through the mechanism of medical knowledge attention. The experimental results show that our approach significantly improves classification performance compared to other state-of-the-art techniques and possesses robustness for each modality from multi-modal data. Moreover, we construct a new COVID-19 multi-modal dataset based on text mining, consisting of 1393 doctor-patient dialogues and their 3706 images (347 X-ray

Indexed as

COVID-19 diagnoseKnowledge attention mechanismKnowledge-based representation learningKnowledge embedding

Identifiers

PMID34093095
PMCPMC8168340
OpenAlexW3168834895

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.