Trial reportArthritis research & therapy2021
Accuracy, patient-perceived usability, and acceptance of two symptom checkers (Ada and Rheport) in rheumatology: interim results from a randomized controlled crossover trial.
Trial report in Arthritis research & therapy, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 50 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
50 citing papers in PubMed.
- RhePort 1.3 enhances early identification of inflammatory rheumatic diseases: a prospective study in German rheumatology settings.Rheumatology international · 2025Trial
- Comparison of Two Symptom Checkers (Ada and Symptoma) in the Emergency Department: Randomized, Crossover, Head-to-Head, Double-Blinded Study.Journal of medical Internet research · 2024Trial
- Diagnostic Accuracy of a Mobile AI-Based Symptom Checker and a Web-Based Self-Referral Tool in Rheumatology: Multicenter Randomized Controlled Trial.Journal of medical Internet research · 2024Trial
- Accuracy and tolerability of self-sampling of capillary blood for analysis of inflammation and autoantibodies in rheumatoid arthritis patients-results from a randomized controlled trial.Arthritis research & therapy · 2022Trial
- Patient's Perception of Digital Symptom Assessment Technologies in Rheumatology: Results From a Multicentre Study.Frontiers in public health · 2022Trial
- Accuracy and usability of a diagnostic decision support system in the diagnosis of three representative rheumatic diseases: a randomized controlled trial among medical students.Arthritis research & therapy · 2021Trial
- Evidence for Digital Health Tools Designed to Support the Triage of Musculoskeletal Conditions in Primary, Urgent, and Emergency Care Settings: Scoping Review.Journal of medical Internet research · 2026Article
- Attrition and representativeness in development and validation of online symptom checkers-a case study on theFrontiers in artificial intelligence · 2026Article
- Development and validation of a clinical risk prediction rule to identify inflammatory arthritis at the point of rheumatology triage.Rheumatology advances in practice · 2026Article
- Evaluating the Accuracy of the Frysian Questionnaire for Differentiation of Musculoskeletal Complaints for Triage of Musculoskeletal Diseases: Algorithm Development and Validation Study.JMIR medical informatics · 2025Article
- Creating Digital Health Technology for Gender Equity: a Capabilities Approach.Public health ethics · 2025Article
- Rheumatic? A diagnostic decision support tool for individuals suspecting rheumatic diseases: Mixed-methods usability and acceptability study.BMC rheumatology · 2025Article
- [Prioritized appointment allocation in new patients, what is really decisive? : Comparative analysis of manual appointment allocation with automated and AI-assisted approaches].Zeitschrift fur Rheumatologie · 2025Article
- Patient-Reported Outcomes of Depression and Fibromyalgia Symptoms Do Not Predict Non-Inflammatory versus Inflammatory Diagnoses at Initial Rheumatology Consultation.Healthcare (Basel, Switzerland) · 2024Article
- Prioritising Appointments by Telephone Interview: Duration from Symptom Onset to Appointment Request Predicts Likelihood of Inflammatory Rheumatic Disease.Journal of clinical medicine · 2024Article
- [Rheumatological care in Germany : Memorandum of the German Society for Rheumatology and Clinical Immunology 2024].Zeitschrift fur Rheumatologie · 2024Article
- Controlling Inputter Variability in Vignette Studies Assessing Web-Based Symptom Checkers: Evaluation of Current Practice and Recommendations for Isolated Accuracy Metrics.JMIR formative research · 2024Article
- Testing Two Online Symptom Checkers With Vulnerable Groups: Usability Study to Improve Cognitive Accessibility of eHealth Services.JMIR human factors · 2024Article
- "That's just Future Medicine" - a qualitative study on users' experiences of symptom checker apps.BMC medical ethics · 2024Article
- Diagnostic accuracy of a large language model in rheumatology: comparison of physician and ChatGPT-4.Rheumatology international · 2024Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
23 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundTimely diagnosis and treatment are essential in the effective management of inflammatory rheumatic diseases (IRDs). Symptom checkers (SCs) promise to accelerate diagnosis, reduce misdiagnoses, and guide patients more effectively through the health care system. Although SCs are increasingly used, there exists little supporting evidence.
objectiveTo assess the diagnostic accuracy, patient-perceived usability, and acceptance of two SCs: (1) Ada and (2) Rheport.
methodsPatients newly presenting to a German secondary rheumatology outpatient clinic were randomly assigned in a 1:1 ratio to complete Ada or Rheport and consecutively the respective other SCs in a prospective non-blinded controlled randomized crossover trial. The primary outcome was the accuracy of the SCs regarding the diagnosis of an IRD compared to the physicians' diagnosis as the gold standard. The secondary outcomes were patient-perceived usability, acceptance, and time to complete the SC.
resultsIn this interim analysis, the first 164 patients who completed the study were analyzed. 32.9% (54/164) of the study subjects were diagnosed with an IRD. Rheport showed a sensitivity of 53.7% and a specificity of 51.8% for IRDs. Ada's top 1 (D1) and top 5 disease suggestions (D5) showed a sensitivity of 42.6% and 53.7% and a specificity of 63.6% and 54.5% concerning IRDs, respectively. The correct diagnosis of the IRD patients was within the Ada D1 and D5 suggestions in 16.7% (9/54) and 25.9% (14/54), respectively. The median System Usability Scale (SUS) score of Ada and Rheport was 75.0/100 and 77.5/100, respectively. The median completion time for both Ada and Rheport was 7.0 and 8.5 min, respectively. Sixty-four percent and 67.1% would recommend using Ada and Rheport to friends and other patients, respectively.
conclusionsWhile SCs are well accepted among patients, their diagnostic accuracy is limited to date.
trial registrationDRKS.de, DRKS00017642 . Registered on 23 July 2019.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.