ArticleAIDS and behavior2024
Assessing ChatGPT's Potential in HIV Prevention Communication: A Comprehensive Evaluation of Accuracy, Completeness, and Inclusivity.
Article in AIDS and behavior, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
14 citing papers in PubMed.
- Developing an HIV Pre-Exposure Prophylaxis Toolkit for Adolescent and Young Adults: Serving Primary Care Providers to Support Future Implementation Using the Consolidated Framework for Implementation Research.AIDS patient care and STDs · 2026Article
- Article
- ChatGPT in precision medicine.APL bioengineering · 2026Review
- Enhancing LGBTQ+ Inclusivity in an AI-Powered Sexual Health Chatbot: User-Centered Design Approach Through a Nonprofit and Academic Partnership.Journal of medical Internet research · 2026Article
- Comparison of the accuracy and reliability of ChatGPT-4o and Gemini in answering HIV-related questions.BMC infectious diseases · 2025Article
- HIV Prevention and Treatment Information from Four Artificial Intelligence Platforms: A Thematic Analysis.AIDS and behavior · 2025Article
- Comparative Evaluation of Responses from ChatGPT-5, Gemini 2.5 Flash, Grok 4, and Claude Sonnet-4 Chatbots to Questions About Endodontic Iatrogenic Events.Healthcare (Basel, Switzerland) · 2025Article
- Evaluation of ChatGPT-4's performance on pediatric dentistry questions: accuracy and completeness analysis.BMC oral health · 2025Article
- Article
- Assessing the Accuracy, Completeness and Safety of ChatGPT-4o Responses on Pressure Injuries in Infants: Clinical Applications and Future Implications.Nursing reports (Pavia, Italy) · 2025Article
- Assessing the clinical support capabilities of ChatGPT 4o and ChatGPT 4o mini in managing lumbar disc herniation.European journal of medical research · 2025Article
- AI-Driven Large Language Models in Health Consultations for HIV Patients.Journal of multidisciplinary healthcare · 2025Article
- The Role of Artificial Intelligence in the Primary Prevention of Common Musculoskeletal Diseases.Cureus · 2024Article
- Assessing the accuracy and clinical utility of GPT-4O in abnormal blood cell morphology recognition.Digital healthArticle
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
26 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
With the advancement of artificial intelligence(AI), platforms like ChatGPT have gained traction in different fields, including Medicine. This study aims to evaluate the potential of ChatGPT in addressing questions related to HIV prevention and to assess its accuracy, completeness, and inclusivity. A team consisting of 15 physicians, six members from HIV communities, and three experts in gender and queer studies designed an assessment of ChatGPT. Queries were categorized into five thematic groups: general HIV information, behaviors increasing HIV acquisition risk, HIV and pregnancy, HIV testing, and the prophylaxis use. A team of medical doctors was in charge of developing questions to be submitted to ChatGPT. The other members critically assessed the generated responses regarding level of expertise, accuracy, completeness, and inclusivity. The median accuracy score was 5.5 out of 6, with 88.4% of responses achieving a score ≥ 5. Completeness had a median of 3 out of 3, while the median for inclusivity was 2 out of 3. Some thematic groups, like behaviors associated with HIV transmission and prophylaxis, exhibited higher accuracy, indicating variable performance across different topics. Issues of inclusivity were identified, notably the use of outdated terms and a lack of representation for some communities. ChatGPT demonstrates significant potential in providing accurate information on HIV-related topics. However, while responses were often scientifically accurate, they sometimes lacked the socio-political context and inclusivity essential for effective health communication. This underlines the importance of aligning AI-driven platforms with contemporary health communication strategies and ensuring the balance of accuracy and inclusivity.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.