Evidence map›Paper›PMID 42718767›Full record

ArticleFrontiers in public health2026

Toward safer digital sexual health communication: evaluating the public health reliability of large language model responses on sexually transmitted infections.

Shucheng Zhang, Shuo Wang, Xiaoyue Sun, Zhuqing Li, Yang Lin, Jiale Geng, Xiaoqing Si

Abstract read
In one paragraph

Article in Frontiers in public health, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Shucheng Zhang *Department of Dermatology, The First Affiliated Hospital of Shandong First Medical University, Jinan, China.
Shuo Wang *Department of Urology, The First Affiliated Hospital of Shandong First Medical University, Jinan, China.
Xiaoyue Sun *Department of Dermatology, The First Affiliated Hospital of Shandong First Medical University, Jinan, China.
Zhuqing LiDepartment of Dermatology, The First Affiliated Hospital of Shandong First Medical University, Jinan, China.
Yang LinDepartment of Dermatology, The First Affiliated Hospital of Shandong First Medical University, Jinan, China.
Jiale GengDepartment of Dermatology, The First Affiliated Hospital of Shandong First Medical University, Jinan, China.
Xiaoqing SiDepartment of Dermatology, The First Affiliated Hospital of Shandong First Medical University, Jinan, China.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: The global burden of sexually transmitted infections (STIs) continues to rise, yet stigma drives many to seek sensitive health information from artificial intelligence chatbots. The quality, safety, readability, and destigmatization of large language model (LLM) responses on sexual health remain under-evaluated, particularly for non-Western models. Methods: This cross-sectional study constructed 30 standardized English queries (5 themes × 6 questions) informed by Google Trends, Centers for Disease Control and Prevention (CDC) guidelines, and patient education platforms, and submitted them to three LLMs-GPT-5.4, DeepSeek-V4-Pro, and Kimi K2.6-via official APIs, in duplicate (180 responses). Two dermatovenereologists (>10 years' experience) rated the responses while blinded to platform identity, across six dimensions (accuracy, completeness, safety, understandability, actionability, and destigmatization) using a five-point scale, supplemented by four readability metrics (FKGL, FRE, GFI, and SMOG). Primary analysis used linear mixed-effects models retaining all individual ratings; the original aggregated non-parametric pipeline was retained as a sensitivity analysis. Reliability used ICC and quadratic-weighted Cohen's κ with 95% CIs; correlations used query-level cluster bootstrap with false-discovery-rate control. Results: Inter-platform differences were significant for accuracy (χ Conclusions: The three LLMs showed distinct profiles: GPT-5.4 and Kimi K2.6 achieved the highest accuracy, whereas GPT-5.4 produced the least readable outputs; DeepSeek-V4-Pro and Kimi K2.6 used more destigmatizing language. To our knowledge, this is the first study to quantify destigmatizing language as an explicit evaluation dimension for LLM-generated STI content, albeit as an exploratory measure pending formal content validation. Findings are specific to these models and queries and can inform quality standards and monitoring for safer AI-powered sexual health communication.

Indexed as

Health CommunicationLarge Language ModelsPublic HealthSexual HealthSexually Transmitted DiseasesCross-Sectional StudiesDigital HealthHumansReproducibility of Resultsdigital healthhealth equitylarge language modelpublic healthsexually transmitted infectionstigma-free language

Identifiers

PMID42718767
PMCPMC13553913

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.