Evidence map›Paper›PMID 40982722›Full record

ArticleScandinavian journal of primary health care2026

Evaluating digital triage symptom checker with historical triage-related adverse events.

Jonathan Ilicki, Sandra Edman, Joacim Stalfors, Carl Johan Molin

Abstract read
In one paragraph

Article in Scandinavian journal of primary health care, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Jonathan IlickiPlatform24 Healthcare AB, Stockholm, Sweden.ORCID 0000-0002-6514-8554
Sandra EdmanPlatform24 Healthcare AB, Stockholm, Sweden.ORCID 0000-0002-1929-5852
Joacim StalforsPlatform24 Healthcare AB, Stockholm, Sweden.ORCID 0000-0002-5115-8102
Carl Johan MolinPlatform24 Healthcare AB, Stockholm, Sweden.ORCID 0000-0001-6330-9361

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundOnline symptom checkers are increasingly used for diagnostic support and triage. However, evidence on their performance and evaluations with real-world data remains limited.

objectiveThe aim of this study was to evaluate the performance of a digital symptom checker using clinical vignettes derived from real-world cases that had previously been incorrectly triaged.

methodsA patient-facing, rule-based digital symptom checker used in Swedish primary care was assessed in this study. Vignettes were constructed from cases reported to the Swedish Health and Social Care Inspectorate due to erroneous telephone triage. We hypothesized that the digital symptom checker could provide appropriate triage for these cases. Seven physicians independently simulated patients by entering symptoms in the symptom checker based on each vignette. Triage outcomes were assessed against the Swedish National Triage Guidelines (RGS), evaluating the accuracy and the safety of the triage recommendation.

resultsA total of 69 unique vignettes yielded 483 individual trials. After excluding 93 trials due to significant deviations from the original vignette description (adding or omitting symptoms), 390 trials were included in the primary analysis. The symptom checker achieved 91% accuracy (95% CI 88-94%) and 94% safety (95% CI 91-96%).

conclusionsThe symptom checker demonstrated high accuracy and safety when triaging a subset of vignettes based on real-world cases that had been previously erroneously triaged. This study also highlights the difficulties of using vignettes when evaluating symptom checkers. To our knowledge, this is the first study to evaluate such systems using vignettes based on actual patient cases with known triage errors.

Indexed as

Symptom AssessmentTriageFemaleHumansMaleMiddle AgedPatient SimulationPrimary Health CareSwedendigital healthdigital triagemobile applicationsprimary care triagesymptom checkerTriageurgency

Identifiers

PMID40982722
PMCPMC12918410

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.