Evidence map›Paper›PMID 38122815›Full record

ArticleMethods of information in medicine2023

Use of Natural Language Processing to Identify Sexual and Reproductive Health Information in Clinical Text.

Elizabeth I Harrison, Laura A Kirkpatrick, Patrick W Harrison, Traci M Kazmerski, Yoshimi Sogawa, Harry S Hochheiser

Abstract read
In one paragraph

Article in Methods of information in medicine, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Elizabeth I HarrisonDepartment of Pediatrics, UPMC Children's Hospital of Pittsburgh, Pittsburgh, Pennsylvania, United States.
Laura A KirkpatrickDepartment of Pediatrics, UPMC Children's Hospital of Pittsburgh, Pittsburgh, Pennsylvania, United States.
Patrick W HarrisonData Theoretic, Pittsburgh, Pennsylvania, United States.
Traci M KazmerskiDepartment of Pediatrics, UPMC Children's Hospital of Pittsburgh, Pittsburgh, Pennsylvania, United States.
Yoshimi SogawaDepartment of Pediatrics, UPMC Children's Hospital of Pittsburgh, Pittsburgh, Pennsylvania, United States.
Harry S HochheiserDepartment of Biomedical Informatics, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, United States.

Funding

Child Neurologist Career Development Program (CNCDP)K12NS098482 · NINDS · HUGO W. MOSER RES INST KENNEDY KRIEGER · PI SCHLAGGAR, BRADLEY L · 2016 to 2025
$26.2M
American Academy of Neurology 1212269NICHD NIH HHS L40 HD113008NINDS NIH HHS K12 NS098482
6 · The paper itself

Abstract

objectivesThis study aimed to enable clinical researchers without expertise in natural language processing (NLP) to extract and analyze information about sexual and reproductive health (SRH), or other sensitive health topics, from large sets of clinical notes.

methods(1) We retrieved text from the electronic health record as individual notes. (2) We segmented notes into sentences using one of scispaCy's NLP toolkits. (3) We exported sentences to the labeling application Watchful and annotated subsets of these as relevant or irrelevant to various SRH categories by applying a combination of regular expressions and manual annotation. (4) The labeled sentences served as training data to create machine learning models for classifying text; specifically, we used spaCy's default text classification ensemble, comprising a bag-of-words model and a neural network with attention. (5) We applied each model to unlabeled sentences to identify additional references to SRH with novel relevant vocabulary. We used this information and repeated steps 3 to 5 iteratively until the models identified no new relevant sentences for each topic. Finally, we aggregated the labeled data for analysis.

resultsThis methodology was applied to 3,663 Child Neurology notes for 971 female patients. Our search focused on six SRH categories. We validated the approach using two subject matter experts, who independently labeled a sample of 400 sentences. Cohen's kappa values were calculated for each category between the reviewers (menstruation: 1, sexual activity: 0.9499, contraception: 0.9887, folic acid: 1, teratogens: 0.8864, pregnancy: 0.9499). After removing the sentences on which reviewers did not agree, we compared the reviewers' labels to those produced via our methodology, again using Cohen's kappa (menstruation: 1, sexual activity: 1, contraception: 0.9885, folic acid: 1, teratogens: 0.9841, pregnancy: 0.9871).

conclusionOur methodology is reproducible, enables analysis of large amounts of text, and has produced results that are highly comparable to subject matter expert manual review.

Indexed as

Natural Language ProcessingReproductive HealthChildElectronic Health RecordsFemaleFolic AcidHumansSexual BehaviorTeratogensFolic AcidTeratogens

Identifiers

PMID38122815
PMCPMC13288149

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.