Evidence map›Paper›PMID 34749701›Full record

ArticleBMC medical informatics and decision making2021

Establishing an expert consensus for the operational definitions of asthma-associated infectious and inflammatory multimorbidities for computational algorithms through a modified Delphi technique.

Jungwon Yoon, Heather Billings, Chung-Il Wi, Elissa Hall, Sunghwan Sohn, Jung Hyun Kwon, Euijung Ryu, Pragya Shrestha, Hongfang Liu, Young J Juhn

Abstract readConsensus Statement
In one paragraph

Article in BMC medical informatics and decision making, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Jungwon YoonDepartment of Pediatric and Adolescent Medicine, Mayo Clinic, Rochester, MN, USA.
Heather BillingsOffice of Applied Scholarship and Education Science, Mayo Clinic, Rochester, MN, USA.
Chung-Il WiDepartment of Pediatric and Adolescent Medicine, Mayo Clinic, Rochester, MN, USA.
Elissa HallOffice of Applied Scholarship and Education Science, Mayo Clinic, Rochester, MN, USA.
Sunghwan SohnDivision of Digital Health Sciences, Mayo Clinic, Rochester, MN, USA.
Jung Hyun KwonDepartment of Pediatric and Adolescent Medicine, Mayo Clinic, Rochester, MN, USA.
Euijung RyuDivision of Biomedical Statistics and Informatics, Mayo Clinic, Rochester, MN, USA.
Pragya ShresthaDepartment of Pediatric and Adolescent Medicine, Mayo Clinic, Rochester, MN, USA.
Hongfang LiuDivision of Digital Health Sciences, Mayo Clinic, Rochester, MN, USA.
Young J JuhnPrecision Population Science Lab, Mayo Clinic, Rochester, MN, USA. Juhn.young@mayo.edu.ORCID 0000-0003-2112-4240

Funding

TRAINING GRANT IN CLINICAL PHARMACOLOGYT32GM008685 · NIGMS · MAYO CLINIC ROCHESTER · PI Liewei Wang · 1998 to 2026
$8.2M
Identification and characterization of children with asthma-associated comorbidities through computational and immune phenotypingR01HL126667 · NHLBI · MAYO CLINIC ROCHESTER · PI JUHN, YOUNG J, LIU, HONGFANG · 2015 to 2022
$4.3M
Secondary use of EMR for residency training in asthma care and documentationR21AI142702 · NIAID · MAYO CLINIC ROCHESTER · PI JUHN, YOUNG J, SOHN, SUNGHWAN · 2019 to 2020
$437k
National Institute of Allergy and Infectious Diseases R21AI142702NHLBI NIH HHS HL126667NHLBI NIH HHS R01 HL126667NIAID NIH HHS R21 AI142702NIGMS NIH HHS T32 GM008685
6 · The paper itself

Abstract

backgroundA subgroup of patients with asthma has been reported to have an increased risk for asthma-associated infectious and inflammatory multimorbidities (AIMs). To systematically investigate the association of asthma with AIMs using a large patient cohort, it is desired to leverage a broad range of electronic health record (EHR) data sources to automatically identify AIMs accurately and efficiently.

methodsWe established an expert consensus for an operational definition for each AIM from EHR through a modified Delphi technique. A series of questions about the operational definition of 19 AIMS (11 infectious diseases and 8 inflammatory diseases) was generated by a core team of experts who considered feasibility, balance between sensitivity and specificity, and generalizability. Eight internal and 5 external expert panelists were invited to individually complete a series of online questionnaires and provide judgement and feedback throughout three sequential internal rounds and two external rounds. Panelists' responses were collected, descriptive statistics tabulated, and results reported back to the entire group. Following each round the core team of experts made iterative edits to the operational definitions until a moderate (≥ 60%) or strong (≥ 80%) level of consensus among the panel was achieved.

resultsResponse rates for each Delphi round were 100% in all 5 rounds with the achievement of the following consensus levels: (1) Internal panel consensus: 100% for 8 definitions, 88% for 10 definitions, and 75% for 1 definition, (2) External panel consensus: 100% for 12 definitions and 80% for 7 definitions.

conclusionsThe final operational definitions of AIMs established through a modified Delphi technique can serve as a foundation for developing computational algorithms to automatically identify AIMs from EHRs to enable large scale research studies on patient's multimorbidities associated with asthma.

Indexed as

AsthmaCommunicable DiseasesAlgorithmsConsensusDelphi TechniqueHumansAsthmaDelphiElectronic health recordsMultimorbiditiesNatural language processing

Identifiers

PMID34749701
PMCPMC8573872

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.