Evidence map›Paper›PMID 19259269›Full record

ArticlePloS one2009

Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPDASi).

Glyn Elwyn, Annette M O'Connor, Carol Bennett, Robert G Newcombe, Mary Politi, Marie-Anne Durand, Elizabeth Drake, Natalie Joseph-Williams, Sara Khangura, Anton Saarimaki and 14 more

Abstract readValidation Study
In one paragraph

Article in PloS one, 2009. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 223 papers, 17 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
223citing papers in PubMed, 17 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

223 citing papers in PubMed, 17 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Kidney disease pathways, options and decisions: an environmental scan of international patient decision aids.Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association · 2020
    Pooled it
  7. Pooled it
  8. Pooled it
  9. Pooled it
  10. Pooled it
  11. Pooled it
  12. Pooled it
  13. Decision aids for people considering taking part in clinical trials.The Cochrane database of systematic reviews · 2015
    Pooled it
  14. Pooled it
  15. Pooled it
  16. Addressing health literacy in patient decision aids.BMC medical informatics and decision making · 2013
    Pooled it
  17. Pooled it
  18. Trial
  19. Trial
  20. Trial

163 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

24 authors.

Glyn ElwynDepartment of Primary Care and Public Health, School of Medicine and the School of Psychology, Cardiff University, Cardiff, United Kingdom. elwyng@cardiff.ac.uk
Annette M O'Connor
Carol Bennett
Robert G Newcombe
Mary Politi
Marie-Anne Durand
Elizabeth Drake
Natalie Joseph-Williams
Sara Khangura
Anton Saarimaki
Stephanie Sivell
Mareike Stiel
Steven J Bernstein
Nananda Col
Angela Coulter
Karen Eden
Martin Härter
Margaret Holmes Rovner
Nora Moumjid
Dawn Stacey
Richard Thomson
Tim Whelan
Trudy van der Weijden
Adrian Edwards

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesTo describe the development, validation and inter-rater reliability of an instrument to measure the quality of patient decision support technologies (decision aids).

designScale development study, involving construct, item and scale development, validation and reliability testing.

settingThere has been increasing use of decision support technologies--adjuncts to the discussions clinicians have with patients about difficult decisions. A global interest in developing these interventions exists among both for-profit and not-for-profit organisations. It is therefore essential to have internationally accepted standards to assess the quality of their development, process, content, potential bias and method of field testing and evaluation.

methodsScale development study, involving construct, item and scale development, validation and reliability testing.

participantsTwenty-five researcher-members of the International Patient Decision Aid Standards Collaboration worked together to develop the instrument (IPDASi). In the fourth Stage (reliability study), eight raters assessed thirty randomly selected decision support technologies.

resultsIPDASi measures quality in 10 dimensions, using 47 items, and provides an overall quality score (scaled from 0 to 100) for each intervention. Overall IPDASi scores ranged from 33 to 82 across the decision support technologies sampled (n = 30), enabling discrimination. The inter-rater intraclass correlation for the overall quality score was 0.80. Correlations of dimension scores with the overall score were all positive (0.31 to 0.68). Cronbach's alpha values for the 8 raters ranged from 0.72 to 0.93. Cronbach's alphas based on the dimension means ranged from 0.50 to 0.81, indicating that the dimensions, although well correlated, measure different aspects of decision support technology quality. A short version (19 items) was also developed that had very similar mean scores to IPDASi and high correlation between short score and overall score 0.87 (CI 0.79 to 0.92).

conclusionsThis work demonstrates that IPDASi has the ability to assess the quality of decision support technologies. The existing IPDASi provides an assessment of the quality of a DST's components and will be used as a tool to provide formative advice to DSTs developers and summative assessments for those who want to compare their tools against an existing benchmark.

Indexed as

Decision MakingDecision Support TechniquesPatient ParticipationHumansReproducibility of Results

Identifiers

PMID19259269
PMCPMC2649534

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.