Evidence map›Paper›PMID 36827277›Full record

ArticlePloS one2023

Exploratory study: Evaluation of a symptom checker effectiveness for providing a diagnosis and evaluating the situation emergency compared to emergency physicians using simulated and standardized patients.

Laure Abensur Vuillaume, Julien Turpinier, Lauriane Cipolat, Arnaud-Dépil-Duval, Thomas Dumontier, Nicolas Peschanski, Yann Kieffer, Boris Barbat, Thomas Riquier, Vincent Dinot and 1 more

Abstract read
In one paragraph

Article in PloS one, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Laure Abensur VuillaumeService d'Accueil des Urgences - SAMU 57, CHR Metz-Thionville, Metz, France.ORCID 0000-0003-2527-8458
Julien TurpinierService d'Accueil des Urgences - SAMU 57, CHR Metz-Thionville, Metz, France.
Lauriane CipolatService d'Accueil des Urgences - SAMU 57, CHR Metz-Thionville, Metz, France.
Arnaud-Dépil-DuvalSaint-Joseph Hospital, Paris, France.
Thomas DumontierService d'Accueil des Urgences, CHU Rouen, Rouen, France.
Nicolas PeschanskiService d'Accueil des Urgences, CHU Rennes, Rennes, France.
Yann KiefferOrsay Hospital, Groupe Hospitalier Nord Essonne, Paris, France.
Boris BarbatService d'Accueil des Urgences, APHP, Paris, France.
Thomas RiquierPlateforme Support au Développement Clinique des Solutions Numériques, Digital Medical Hub, Paris, France.
Vincent DinotPlateforme d'appui à la Recherche Clinique, CHR Metz-Thionville, Metz, France.
Joris GallandService de Médecine Interne, Hôpital Fleyriat, CH Bourg-en-Bresse, Viriat, France.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe overloading of health care systems is an international problem. In this context, new tools such as symptom checker (SC) are emerging to improve patient orientation and triage. This SC should be rigorously evaluated and we can take a cue from the way we evaluate medical students, using objective structured clinical examinations (OSCE) with simulated patients.

objectiveThe main objective of this study was to evaluate the efficiency of a symptom checker versus emergency physicians using OSCEs as an assessment method.

methodsWe explored a method to evaluate the ability to set a diagnosis and evaluate the emergency of a situation with simulation. A panel of medical experts wrote 220 simulated patients cases. Each situation was played twice by an actor trained to the role: once for the SC, then for an emergency physician. Like a teleconsultation, only the patient's voice was accessible. We performed a prospective non-inferiority study. If primary analysis had failed to detect non-inferiority, we have planned a superiority analysis.

resultsThe SC established only 30% of the main diagnosis as the emergency physician found 81% of these. The emergency physician was also superior compared to the SC in the suggestion of secondary diagnosis (92% versus 52%). In the matter of patient triage (vital emergency or not), there is still a medical superiority (96% versus 71%). We prove a non-inferiority of the SC compared to the physician in terms of interviewing time. CONCLUSIONS AND RELEVANCE: We should use simulated patients instead of clinical cases in order to evaluate the effectiveness of SCs.

Indexed as

PhysiciansRemote ConsultationVoiceHumansProspective StudiesTriage

Identifiers

PMID36827277
PMCPMC9955603

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.