Evidence map›Paper›PMID 24130231›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2013

Developing and evaluating an automated appendicitis risk stratification algorithm for pediatric patients in the emergency department.

Louise Deleger, Holly Brodzinski, Haijun Zhai, Qi Li, Todd Lingren, Eric S Kirkendall, Evaline Alessandrini, Imre Solti

Open access · bronzeAbstract readEvaluation Study
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 29 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
29citing papers in PubMed, 1 pooled it
2.9field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

29 citing papers in PubMed, 1 synthesis or guideline pooled it, 54 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Artificial intelligence in emergency medicine: A scoping review.Journal of the American College of Emergency Physicians open · 2020
    Article
  13. Review
  14. Article
  15. Article
  16. Quantifying risk factors in medical reports with a context-aware linear model.Journal of the American Medical Informatics Association : JAMIA · 2019
    Article
  17. Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 1 institution in 1 country.

Louise DelegerDivision of Biomedical Informatics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA.
Holly Brodzinski
Haijun Zhai
Qi Li
Todd Lingren
Eric S Kirkendall
Evaline Alessandrini
Imre Solti
Cincinnati Children's Hospital Medical Center · US

Funding

Better Outcomes for Children: GWAS & PheWAS in eMERGEII.U01HG006828 · NHGRI · CINCINNATI CHILDRENS HOSP MED CTR · PI HARLEY, JOHN BARKER, HOLM, INGRID ADELE · 2012 to 2014
$4.0M
Increasing Clinical Trial Enrollment: A Semi-Automated Patient Centered ApproachR00LM010227 · NLM · CINCINNATI CHILDRENS HOSP MED CTR · PI SOLTI, IMRE · 2010 to 2012
$727k
EHR-based patient safety: Automated error detection in neonatal intensive careR21HD072883 · NICHD · CINCINNATI CHILDRENS HOSP MED CTR · PI SOLTI, IMRE · 2012 to 2013
$407k
NHGRI NIH HHS 1U01HG006828-01NHGRI NIH HHS U01 HG006828NICHD NIH HHS 1R21HD072883-01NICHD NIH HHS R21 HD072883NLM NIH HHS 5R00LM010227-04NLM NIH HHS R00 LM010227
6 · The paper itself

Abstract

objectiveTo evaluate a proposed natural language processing (NLP) and machine-learning based automated method to risk stratify abdominal pain patients by analyzing the content of the electronic health record (EHR).

methodsWe analyzed the EHRs of a random sample of 2100 pediatric emergency department (ED) patients with abdominal pain, including all with a final diagnosis of appendicitis. We developed an automated system to extract relevant elements from ED physician notes and lab values and to automatically assign a risk category for acute appendicitis (high, equivocal, or low), based on the Pediatric Appendicitis Score. We evaluated the performance of the system against a manually created gold standard (chart reviews by ED physicians) for recall, specificity, and precision.

resultsThe system achieved an average F-measure of 0.867 (0.869 recall and 0.863 precision) for risk classification, which was comparable to physician experts. Recall/precision were 0.897/0.952 in the low-risk category, 0.855/0.886 in the high-risk category, and 0.854/0.766 in the equivocal-risk category. The information that the system required as input to achieve high F-measure was available within the first 4 h of the ED visit.

conclusionsAutomated appendicitis risk categorization based on EHR content, including information from clinical notes, shows comparable performance to physician chart reviewers as measured by their inter-annotator agreement and represents a promising new approach for computerized decision support to promote application of evidence-based medicine at the point of care.

Indexed as

AlgorithmsElectronic Health RecordsNatural Language ProcessingAbdominal PainAppendicitisArtificial IntelligenceChildEmergency Service, HospitalHumansRisk AssessmentElectronic Health RecordInformation ExtractionNatural Language ProcessingPediatric Appendicitis ScoreRisk Stratification

Identifiers

PMID24130231
PMCPMC3861926
OpenAlexW1814363168

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.