Evidence map›Paper›PMID 37833036›Full record

Trial reportBMJ evidence-based medicine2024

Interpretation and use of a decision support tool for multiple treatment options: a combined randomised controlled trial and survey of medical students.

Birk Stokke Hunskaar, Per Olav Løvsletten, Ashley Muller, Per Olav Vandvik

Abstract readRandomized Controlled Trial
In one paragraph

Trial report in BMJ evidence-based medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Birk Stokke HunskaarInstitute of Health and Society, University of Oslo Faculty of Medicine, Oslo, Norway bbshunskaar@gmail.com.ORCID 0000-0002-3340-0591
Per Olav LøvslettenInstitute of Health and Society, University of Oslo Faculty of Medicine, Oslo, Norway.
Ashley MullerNorwegian Centre for Addiction Research, University of Oslo Faculty of Medicine, Oslo, Norway.
Per Olav VandvikInstitute of Health and Society, University of Oslo Faculty of Medicine, Oslo, Norway.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesTo investigate medical students' ability to interpret evidence, as well as their self-assessed understandability, perceived usefulness and preferences for design alternatives in an interactive decision support tool, displaying GRADE evidence summaries for multiple treatment options (Making Alternative Treatment CHoices Intuitive and Trustworthy, MATCH-IT).

designA combined randomised controlled trial and survey. Participants were presented with a clinical scenario and randomised to one of two versions of the MATCH-IT tool (A/B), instructed to explore the evidence and decide on a recommendation. Participants answered a questionnaire assessing interpretation, treatment recommendation self-assessed understandability and perceived usefulness before exposure to the other MATCH-IT version and asked questions on design preferences.

settingOnline lecture in an evidence-based medicine (EBM) introductory course.

participants149 third-year medical students. 52% (n=77) had 6 months of clinical training and 48% (n=72) had preclinical training only.

interventionsThe MATCH-IT tool version A uses colour coding to categorise interventions by magnitude and direction of effects and displays all outcomes in a table on entry. Version B has no colour coding, and the user must decide which outcomes to display in the table.

main outcome measuresInterpretation of evidence, treatment recommendation, perceived usefulness and understandability, preference for format and design alternatives.

results82.5% (n=123) of medical students correctly answered ≥4 out of 5 multiple choice questions assessing interpretation of data. 75.8% (n=114) of students made a treatment recommendation in accordance with an expert panel for the same clinical scenario. 87.2% (n=130) found the tool understandable while 91.9% perceived the tool as useful in addressing the clinical scenario.

conclusionMedical students with no prior training in EBM can interpret and use the MATCH-IT tool. Certain design alternatives were preferred but had no bearing on interpretation of evidence or understandability of the tool.

Indexed as

Students, MedicalClinical CompetenceEducational MeasurementEvidence-Based MedicineHumansSurveys and QuestionnairesClinical Decision-MakingEvidence-Based PracticeSystematic Reviews as Topic

Identifiers

PMID37833036
PMCPMC10850623

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.