Evidence map›Paper›PMID 34780997›Full record

ArticleAcademic pediatrics2022

Development and Validation of a Natural Language Processing Tool to Identify Injuries in Infants Associated With Abuse.

Gunjan Tiyyagura, Andrea G Asnes, John M Leventhal, Eugene D Shapiro, Marc Auerbach, Wei Teng, Emily Powers, Amy Thomas, Daniel M Lindberg, Justin McClelland and 5 more

Open access · greenAbstract read
In one paragraph

Article in Academic pediatrics, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 2 pooled it
4.3field-weighted citation impact, top 6% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 2 syntheses or guidelines pooled it, 21 citations in OpenAlex.

  1. Pooled it
  2. Identifying Risk Factors of Children Who Suffered Physical Abuse: A Systematic Review.Journal of the American Academy of Orthopaedic Surgeons. Global research & reviews · 2025
    Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Estimating the Prevalence of Child Abuse and Neglect Among Adolescents in Primary Care Through Diagnoses Codes and Free-Text EHR Clinical Notes.Journal of pediatric health care : official publication of National Association of Pediatric Nurse Associates & Practitioners
    Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors at 4 institutions in 2 countries.

Gunjan TiyyaguraYale University School of Medicine (G Tiyyagura, AG Asnes, JM Leventhal, ED Shapiro, M Auerbach, W Teng, E Powers, A Thomas, AL Hsiao), New Haven, CT. Electronic address: gunjan.tiyyagura@yale.edu.
Andrea G AsnesYale University School of Medicine (G Tiyyagura, AG Asnes, JM Leventhal, ED Shapiro, M Auerbach, W Teng, E Powers, A Thomas, AL Hsiao), New Haven, CT.
John M LeventhalYale University School of Medicine (G Tiyyagura, AG Asnes, JM Leventhal, ED Shapiro, M Auerbach, W Teng, E Powers, A Thomas, AL Hsiao), New Haven, CT.
Eugene D ShapiroYale University School of Medicine (G Tiyyagura, AG Asnes, JM Leventhal, ED Shapiro, M Auerbach, W Teng, E Powers, A Thomas, AL Hsiao), New Haven, CT.
Marc AuerbachYale University School of Medicine (G Tiyyagura, AG Asnes, JM Leventhal, ED Shapiro, M Auerbach, W Teng, E Powers, A Thomas, AL Hsiao), New Haven, CT.
Wei TengYale University School of Medicine (G Tiyyagura, AG Asnes, JM Leventhal, ED Shapiro, M Auerbach, W Teng, E Powers, A Thomas, AL Hsiao), New Haven, CT.
Emily PowersYale University School of Medicine (G Tiyyagura, AG Asnes, JM Leventhal, ED Shapiro, M Auerbach, W Teng, E Powers, A Thomas, AL Hsiao), New Haven, CT.
Amy ThomasYale University School of Medicine (G Tiyyagura, AG Asnes, JM Leventhal, ED Shapiro, M Auerbach, W Teng, E Powers, A Thomas, AL Hsiao), New Haven, CT.
Daniel M LindbergUniversity of Colorado Anschutz Medical Campus (DM Lindberg), Aurora Colo.
Justin McClelland3M | M*Modal Health Information Systems (J McClelland, C Kutryb, T Polzin, K Daughtridge, V Sevin), Pittsburg, Pa.
Carol Kutryb3M | M*Modal Health Information Systems (J McClelland, C Kutryb, T Polzin, K Daughtridge, V Sevin), Pittsburg, Pa.
Thomas Polzin3M | M*Modal Health Information Systems (J McClelland, C Kutryb, T Polzin, K Daughtridge, V Sevin), Pittsburg, Pa.
Karen Daughtridge3M | M*Modal Health Information Systems (J McClelland, C Kutryb, T Polzin, K Daughtridge, V Sevin), Pittsburg, Pa.
Virginia Sevin3M | M*Modal Health Information Systems (J McClelland, C Kutryb, T Polzin, K Daughtridge, V Sevin), Pittsburg, Pa.
Allen L HsiaoYale University School of Medicine (G Tiyyagura, AG Asnes, JM Leventhal, ED Shapiro, M Auerbach, W Teng, E Powers, A Thomas, AL Hsiao), New Haven, CT.
Girls Incorporated · USHealth Information Management · BEThomas University · USUniversity of Colorado Anschutz Medical Campus · US

Funding

Yale Clinical and Translational Science Award (U Component)UL1TR001863 · NCATS · YALE UNIVERSITY · PI John H. Krystal, LUCILA OHNO-MACHADO · 2016 to 2026
$102.9M
Short-Term Reserch Training: Students in Health SchoolsT35HL007649 · NHLBI · YALE UNIVERSITY · PI Sarwat I Chaudhry, Erica L Herzog · 1987 to 2026
$5.7M
Training in Patient-Oriented Research for PhysiciansK12RR017594 · NCRR · YALE UNIVERSITY · PI SHAPIRO, EUGENE DAVID · 2003 to 2006
$2.2M
NCATS NIH HHS UL1 TR001863NCRR NIH HHS K12 RR017594NHLBI NIH HHS T35 HL007649
6 · The paper itself

Abstract

objectivesMedically minor but clinically important findings associated with physical child abuse, such as bruises in pre-mobile infants, may be identified by frontline clinicians yet the association of these injuries with child abuse is often not recognized, potentially allowing the abuse to continue and even to escalate. An accurate natural language processing (NLP) algorithm to identify high-risk injuries in electronic health record notes could improve detection and awareness of abuse. The objectives were to: 1) develop an NLP algorithm that accurately identifies injuries in infants associated with abuse and 2) determine the accuracy of this algorithm.

methodsAn NLP algorithm was designed to identify ten specific injuries known to be associated with physical abuse in infants. Iterative cycles of review identified inaccurate triggers, and coding of the algorithm was adjusted. The optimized NLP algorithm was applied to emergency department (ED) providers' notes on 1344 consecutive sample of infants seen in 9 EDs over 3.5 months. Results were compared with review of the same notes conducted by a trained reviewer blind to the NLP results with discrepancies adjudicated by a child abuse expert.

resultsAmong the 1344 encounters, 41 (3.1%) had one of the high-risk injuries. The NLP algorithm had a sensitivity and specificity of 92.7% (95% confidence interval [CI]: 79.0%-98.1%) and 98.1% (95% CI: 97.1%-98.7%), respectively, and positive and negative predictive values were 60.3% and 99.8%, respectively, for identifying high-risk injuries.

conclusionsAn NLP algorithm to identify infants with high-risk injuries in EDs has good accuracy and may be useful to aid clinicians in the identification of infants with injuries associated with child abuse.

Indexed as

Child AbuseNatural Language ProcessingAlgorithmsChildElectronic Health RecordsHumansInfantSensitivity and Specificitychild abuseemergency departmentnatural language processingtest characteristics

Identifiers

PMID34780997
PMCPMC9095755
OpenAlexW3213218629

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.