Comprehensive Evaluation of AI Consent Forms in Otolaryngologic Surgery.

Introduction: Surgical consent documents are frequently written at reading levels exceeding average health literacy. Large language models (LLMs) may offer a scalable approach to generating clearer, procedure-specific consent forms. This study evaluated the clarity, clinical accuracy, and acceptability of consent forms generated by GPT-4 and Claude for common otolaryngologic procedures. Methods: Twenty AI-generated consent forms (10 GPT-4.0, 10 Claude-2.1) were produced using standardized prompts. In a survey-based, non-clinical setting, five board-certified otolaryngologists independently rated each form for medical accuracy, readability, comprehensibility, legal/ethical sufficiency, and usability using a 4-point scale. A cross-sectional cohort of 300 English-speaking adults (15 raters per form) evaluated perceived clarity and signing comfort on 5-point Likert scales, and perceived trust using a binary (Yes/No) item, and completed eight binary quality assessments. A blinded subgroup ( Results: Mean lay ratings for clarity across AI-generated forms were high overall. Claude demonstrated numerically higher scores than GPT-4 for clarity (4.72 vs. 4.68), perceived trust (reported as proportions), and signing comfort (4.40 vs. 4.27). However, when analyzed at the form level, differences between models were not statistically significant for clarity (mean difference 0.04; Conclusions: In a non-clinical evaluation, AI-generated consent forms were perceived as clear and clinically complete, with model-specific trade-offs between perceived clarity and clinical detail. These perception-based findings-reflecting participant ratings of clarity, perceived trust, and willingness to sign rather than objective comprehension-are hypothesis-generating, and prospective clinical and legal validation in more representative patient populations is required.