Evidence map›Paper›PMID 39048640›Full record

ArticleScientific reports2024

Disparities in medical recommendations from AI-based chatbots across different countries/regions.

Khanisyah E Gumilar, Birama R Indraprasta, Yu-Cheng Hsu, Zih-Ying Yu, Hong Chen, Budi Irawan, Zulkarnain Tambunan, Bagus M Wibowo, Hari Nugroho, Brahmana A Tjokroprawiro and 20 more

Abstract read
In one paragraph

Article in Scientific reports, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Article
  5. Review
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. PICOT questions and search strategies formulation: A novel approach using artificial intelligence automation.Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing · 2025
    Article
  12. Article
  13. Article
  14. Article
  15. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

30 authors.

Khanisyah E GumilarGraduate Institute of Biomedical Science, China Medical University, Taichung, Taiwan. khanisyah@fk.unair.ac.id.
Birama R IndraprastaDepartment of Obstetrics and Gynecology, Dr. Soetomo General Hospital-Faculty of Medicine, Universitas Airlangga, Surabaya, Indonesia.
Yu-Cheng HsuDepartment of Public Health, China Medical University, No. 100, Sec. 1, Jingmao Rd, Beitun Dist, Taichung, 406040, Taiwan, ROC.
Zih-Ying YuDepartment of Public Health, China Medical University, No. 100, Sec. 1, Jingmao Rd, Beitun Dist, Taichung, 406040, Taiwan, ROC.
Hong ChenGraduate Institute of Biomedical Science, China Medical University, Taichung, Taiwan.
Budi IrawanDepartment of Obstetrics and Gynecology, Dr. Soetomo General Hospital-Faculty of Medicine, Universitas Airlangga, Surabaya, Indonesia.
Zulkarnain TambunanDepartment of Obstetrics and Gynecology, Dr. Soetomo General Hospital-Faculty of Medicine, Universitas Airlangga, Surabaya, Indonesia.
Bagus M WibowoDepartment of Obstetrics and Gynecology, Dr. Soetomo General Hospital-Faculty of Medicine, Universitas Airlangga, Surabaya, Indonesia.
Hari NugrohoDepartment of Obstetrics and Gynecology, Dr. Soetomo General Hospital-Faculty of Medicine, Universitas Airlangga, Surabaya, Indonesia.
Brahmana A TjokroprawiroDepartment of Obstetrics and Gynecology, Dr. Soetomo General Hospital-Faculty of Medicine, Universitas Airlangga, Surabaya, Indonesia.
Erry G DachlanDepartment of Obstetrics and Gynecology, Dr. Soetomo General Hospital-Faculty of Medicine, Universitas Airlangga, Surabaya, Indonesia.
Pungky MulawardhanaDepartment of Obstetrics and Gynecology, Hospital of Universitas Airlangga-Faculty of Medicine, Universitas Airlangga, Jl. Dharmahusada Permai, Mulyorejo, Kec. Mulyorejo, Surabaya, Jawa Timur, 60115, Indonesia.
Eccita RahestyningtyasDepartment of Obstetrics and Gynecology, Hospital of Universitas Airlangga-Faculty of Medicine, Universitas Airlangga, Jl. Dharmahusada Permai, Mulyorejo, Kec. Mulyorejo, Surabaya, Jawa Timur, 60115, Indonesia.
Herlangga PramudityaDepartment of Obstetrics and Gynecology, Dr. Ramelan Naval Hospital, Surabaya, Indonesia.
Very Great E PutraDepartment of Obstetrics and Gynecology, Dr. Kariadi Central General Hospital, Semarang, Indonesia.
Setyo T WaluyoDepartment of Obstetrics and Gynecology, Ulin General Hospital, Banjarmasin, Indonesia.
Nathan R TanDepartment of Modern and Classical Languages and Literature, University of South Alabama, Mobile, AL, USA.
Royhaan FolarinDepartment of Anatomy, Faculty of Basic Medical Sciences, Olabisi Onabanjo University, Sagamu, Nigeria.
Ibrahim H IbrahimGraduate Institute of Biomedical Science, China Medical University, Taichung, Taiwan.
Cheng-Han LinGraduate Institute of Biomedical Science, China Medical University, Taichung, Taiwan.
Tai-Yu HungGraduate Institute of Biomedical Science, China Medical University, Taichung, Taiwan.
Ting-Fang LuDepartment of Obstetrics and Gynecology, Taichung Veteran General Hospital, 1650 Taiwan Boulevard Sector. 4, Taichung, 40705, Taiwan, ROC.
Yen-Fu ChenDepartment of Obstetrics and Gynecology, Taichung Veteran General Hospital, 1650 Taiwan Boulevard Sector. 4, Taichung, 40705, Taiwan, ROC.
Yu-Hsiang ShihDepartment of Obstetrics and Gynecology, Taichung Veteran General Hospital, 1650 Taiwan Boulevard Sector. 4, Taichung, 40705, Taiwan, ROC.
Shao-Jing WangDepartment of Obstetrics and Gynecology, Taichung Veteran General Hospital, 1650 Taiwan Boulevard Sector. 4, Taichung, 40705, Taiwan, ROC.
Jingshan HuangSchool of Computing and College of Medicine, University of South Alabama, Mobile, AL, USA.
Clayton C YatesDepartment of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, 21287, USA.
Chien-Hsing LuDepartment of Obstetrics and Gynecology, Taichung Veteran General Hospital, 1650 Taiwan Boulevard Sector. 4, Taichung, 40705, Taiwan, ROC. chlu@vghtc.gov.tw.
Li-Na LiaoDepartment of Public Health, China Medical University, No. 100, Sec. 1, Jingmao Rd, Beitun Dist, Taichung, 406040, Taiwan, ROC. linaliao@mail.cmu.edu.tw.
Ming TanGraduate Institute of Biomedical Science, China Medical University, Taichung, Taiwan. mingtan@mail.cmu.edu.tw.

Funding

China Medical University Ying-Tsai Scholar Fund CMU109-YT-04Taiwan Ministry of Education Elite Scholarship
6 · The paper itself

Abstract

This study explores disparities and opportunities in healthcare information provided by AI chatbots. We focused on recommendations for adjuvant therapy in endometrial cancer, analyzing responses across four regions (Indonesia, Nigeria, Taiwan, USA) and three platforms (Bard, Bing, ChatGPT-3.5). Utilizing previously published cases, we asked identical questions to chatbots from each location within a 24-h window. Responses were evaluated in a double-blinded manner on relevance, clarity, depth, focus, and coherence by ten experts in endometrial cancer. Our analysis revealed significant variations across different countries/regions (p < 0.001). Interestingly, Bing's responses in Nigeria consistently outperformed others (p < 0.05), excelling in all evaluation criteria (p < 0.001). Bard also performed better in Nigeria compared to other regions (p < 0.05), consistently surpassing them across all categories (p < 0.001, with relevance reaching p < 0.01). Notably, Bard's overall scores were significantly higher than those of ChatGPT-3.5 and Bing in all locations (p < 0.001). These findings highlight disparities and opportunities in the quality of AI-powered healthcare information based on user location and platform. This emphasizes the necessity for more research and development to guarantee equal access to trustworthy medical information through AI technologies.

Indexed as

Artificial IntelligenceEndometrial NeoplasmsFemaleHumansNigeriaTaiwanUnited StatesArtificial intelligenceBardBingChatGPTDisparityEndometrial cancer

Identifiers

PMID39048640
PMCPMC11269683

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.