Evidence map›Paper›PMID 28506958›Full record

ArticleJournal of medical Internet research2017

Enhancing Comparative Effectiveness Research With Automated Pediatric Pneumonia Detection in a Multi-Institutional Clinical Repository: A PHIS+ Pilot Study.

Stephane Meystre, Ramkiran Gouripeddi, Joel Tieder, Jeffrey Simmons, Rajendu Srivastava, Samir Shah

Open access · goldAbstract readMulticenter Study
In one paragraph

Article in Journal of medical Internet research, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 1 pooled it
1.4field-weighted citation impact, top 19% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 1 synthesis or guideline pooled it, 23 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Development and Performance of Electronic Pediatric Risk of Mortality and Pediatric Logistic Organ Dysfunction-2 Automated Acuity Scores.Pediatric critical care medicine : a journal of the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies · 2019
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 4 institutions in 1 country.

Stephane MeystreMedical University of South Carolina, Charleston, SC, United States.ORCID 0000-0002-7632-9625
Ramkiran GouripeddiDepartment of Biomedical Informatics, University of Utah, Salt Lake City, UT, United States.ORCID 0000-0002-4345-9669
Joel TiederSeattle Children's Hospital and University of Washington, Seattle, WA, United States.ORCID 0000-0001-6539-7115
Jeffrey SimmonsCincinnati Children's Hospital Medical Center, Cincinnati, OH, United States.ORCID 0000-0001-5069-4491
Rajendu SrivastavaDepartment of Pediatrics, University of Utah, Salt Lake City, UT, United States.ORCID 0000-0003-0649-6222
Samir ShahCincinnati Children's Hospital Medical Center, Cincinnati, OH, United States.ORCID 0000-0001-7902-7000
Cincinnati Children's Hospital Medical Center · USMedical University of South Carolina · USSeattle Children's Hospital · USUniversity of Utah · US

Funding

PHIS+: Augmenting the Pediatric Health Information System with Clinical DataR01HS019862 · AHRQ · CHILDREN'S HOSP OF PHILADELPHIA · PI KEREN, RON · 2010 to 2012
$8.7M
AHRQ HHS R01 HS019862
6 · The paper itself

Abstract

backgroundCommunity-acquired pneumonia is a leading cause of pediatric morbidity. Administrative data are often used to conduct comparative effectiveness research (CER) with sufficient sample sizes to enhance detection of important outcomes. However, such studies are prone to misclassification errors because of the variable accuracy of discharge diagnosis codes.

objectiveThe aim of this study was to develop an automated, scalable, and accurate method to determine the presence or absence of pneumonia in children using chest imaging reports.

methodsThe multi-institutional PHIS+ clinical repository was developed to support pediatric CER by expanding an administrative database of children's hospitals with detailed clinical data. To develop a scalable approach to find patients with bacterial pneumonia more accurately, we developed a Natural Language Processing (NLP) application to extract relevant information from chest diagnostic imaging reports. Domain experts established a reference standard by manually annotating 282 reports to train and then test the NLP application. Findings of pleural effusion, pulmonary infiltrate, and pneumonia were automatically extracted from the reports and then used to automatically classify whether a report was consistent with bacterial pneumonia.

resultsCompared with the annotated diagnostic imaging reports reference standard, the most accurate implementation of machine learning algorithms in our NLP application allowed extracting relevant findings with a sensitivity of .939 and a positive predictive value of .925. It allowed classifying reports with a sensitivity of .71, a positive predictive value of .86, and a specificity of .962. When compared with each of the domain experts manually annotating these reports, the NLP application allowed for significantly higher sensitivity (.71 vs .527) and similar positive predictive value and specificity .

conclusionsNLP-based pneumonia information extraction of pediatric diagnostic imaging reports performed better than domain experts in this pilot study. NLP is an efficient method to extract information from a large collection of imaging reports to facilitate CER.

Indexed as

Natural Language ProcessingChildComparative Effectiveness ResearchHumansMedical InformaticsPilot ProjectsPneumoniacomparative effectiveness researchmedical informaticsnatural language processingpneumonia, bacterial

Identifiers

PMID28506958
PMCPMC5447826
OpenAlexW2613226128

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.