ArticleScientific reports2024
Evaluation of the reliability and readability of ChatGPT-4 responses regarding hypothyroidism during pregnancy.
Article in Scientific reports, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 71 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
71 citing papers in PubMed, 106 citations in OpenAlex.
- Comparative Expert Evaluation of Multimodal Large Language Models for Pediatric Rash Diagnosis: Clinical Utility, Safety, Information Quality, and Readability.Children (Basel, Switzerland) · 2026Article
- Readability of AI-Generated Patient Visit Summaries in Orthopedic Surgery: Retrospective Analysis.Journal of medical Internet research · 2026Article
- Assessment of ChatGPT's Performance on the ACP 2024 National Prosthodontics Resident Exam (NPRE).European journal of dental education : official journal of the Association for Dental Education in Europe · 2026Article
- Quality, completeness, readability, and response time of AI chatbots in the management of deep caries and pulp exposure: a bilingual comparative study.BMC oral health · 2026Article
- Accuracy and readability of LLM-generated responses for gout management: a benchmark study based on ACR guidelines.Clinical rheumatology · 2026Article
- Assessing the Quality, Usefulness, and Reliability of Large Language Models (ChatGPT, DeepSeek, and Gemini) in Answering General Questions Regarding Dyslexia and Dyscalculia.The Psychiatric quarterly · 2026Article
- Evaluating large language models for orthodontic consultation in patients with periodontitis: a study of reliability, quality, and readability.BMC oral health · 2026Article
- Performance of three large language models in answering parent-focused questions on rickets: a dual pediatric-orthopedic specialist evaluation.BMC pediatrics · 2026Article
- A cross-sectional analysis of the quality and reliability of Wilson disease videos on Bilibili, Douyin, and Kuaishou.Scientific reports · 2026Article
- Artificial intelligence in obstetrics and gynecology: Evaluating ChatGPT and Google Gemini in answering patient questions.International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics · 2026Article
- Gemini 1.5 Flash provides the most reliable content while ChatGPT-4o offers the highest readability for patient education on meniscal tears.Knee surgery, sports traumatology, arthroscopy : official journal of the ESSKA · 2026Article
- Guidelines vs. generative AI in CKD patient education: the role of prompt engineering and expert blinded evaluation.BMC nephrology · 2026Article
- Assessing the accuracy, reliability, quality, and readability of artificial intelligence chatbots in patient education: insights from zirconia crowns.BMC oral health · 2026Article
- Artificial intelligence in endocrine practice: comparing ChatGPT, Gemini, and Claude for adrenal incidentaloma care.Journal of endocrinological investigation · 2026Article
- Evaluating AI-generated patient education materials for endometrial cancer surgery: a comparative analysis of response quality, reliability, and readability between ChatGPT and DeepSeek models.Frontiers in public health · 2026Article
- Does the Quality and Readability of Information Related to Varicocele Obtained from ChatGPT 4.0 Remain Consistent Across Different Models of Inquiry?The world journal of men's health · 2026Article
- Evaluating the quality and readability of AI-generated information on adenomyosis: a comparative analysis of ChatGPT and deepseek regarding query-model consistency.Frontiers in public health · 2026Article
- Assessing retina-specific ophthalmic counseling generated by an early public large language model across different levels of clinical urgency.Frontiers in digital health · 2026Article
- Evaluating Chain-of-Thought reasoning in large language models for thyroid ultrasound interpretation: a dual-information approach.Frontiers in artificial intelligence · 2026Article
- ChatGPT-5 as a leisure health advisor: multidimensional assessment of reliability, quality, usefulness and readability.Frontiers in public health · 2026Article
11 more citing papers are in PubMed but not listed here.
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
5 authors at 1 institution in 1 country.
Funding
No grant is acknowledged in the PubMed record.
Abstract
Hypothyroidism is characterized by thyroid hormone deficiency and has adverse effects on both pregnancy and fetal health. Chat Generative Pre-trained Transformer (ChatGPT) is a large language model trained with a very large database from many sources. Our study was aimed to evaluate the reliability and readability of ChatGPT-4 answers about hypothyroidism in pregnancy. A total of 19 questions were created in line with the recommendations in the latest guideline of the American Thyroid Association (ATA) on hypothyroidism in pregnancy and were asked to ChatGPT-4. The reliability and quality of the responses were scored by two independent researchers using the global quality scale (GQS) and modified DISCERN tools. The readability of ChatGPT was assessed used Flesch Reading Ease (FRE) Score, Flesch-Kincaid grade level (FKGL), Gunning Fog Index (GFI), Coleman-Liau Index (CLI), and Simple Measure of Gobbledygook (SMOG) tools. No misleading information was found in any of the answers. The mean mDISCERN score of the responses was 30.26 ± 3.14; the median GQS score was 4 (2-4). In terms of reliability, most of the answers showed moderate (78.9%) followed by good (21.1%) reliability. In the readability analysis, the median FRE was 32.20 (13.00-37.10). The years of education required to read the answers were mostly found at the university level [9 (47.3%)]. Although ChatGPT-4 has significant potential, it can be used as an auxiliary information source for counseling by creating a bridge between patients and clinicians about hypothyroidism in pregnancy. Efforts should be made to improve the reliability and readability of ChatGPT.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.