Evidence map›Paper›PMID 34333646›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2021

Trading off accuracy and explainability in AI decision-making: findings from 2 citizens' juries.

Sabine N van der Veer, Lisa Riste, Sudeh Cheraghi-Sohi, Denham L Phipps, Mary P Tully, Kyle Bozentko, Sarah Atwood, Alex Hubbard, Carl Wiper, Malcolm Oswald and 1 more

Open access · hybridAbstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 29 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
29citing papers in PubMed, 2 pooled it
3.2field-weighted citation impact, top 8% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

29 citing papers in PubMed, 2 syntheses or guidelines pooled it, 81 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Review
  4. Article
  5. Review
  6. Article
  7. Review
  8. Review
  9. Article
  10. Article
  11. Article
  12. AI ethics for the everyday intensivist.Critical care and resuscitation : journal of the Australasian Academy of Critical Care Medicine · 2025
    Article
  13. Review
  14. Article
  15. Article
  16. Article
  17. Review
  18. Should AI models be explainable to clinicians?Critical care (London, England) · 2024
    Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 2 institutions in 1 country.

Sabine N van der VeerCentre for Health Informatics, Division of Informatics, Imaging and Data Science, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK.ORCID 0000-0003-0929-436X
Lisa RisteNIHR Greater Manchester Patient Safety Translational Research Centre, School of Health Sciences, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK.
Sudeh Cheraghi-SohiNIHR Greater Manchester Patient Safety Translational Research Centre, School of Health Sciences, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK.
Denham L PhippsDivision of Pharmacy and Optometry, School of Health Sciences, The University of Manchester, Manchester, UK.
Mary P TullyDivision of Pharmacy and Optometry, School of Health Sciences, The University of Manchester, Manchester, UK.
Kyle BozentkoJefferson Center, Saint Paul, Minnesota, USA.
Sarah AtwoodJefferson Center, Saint Paul, Minnesota, USA.
Alex HubbardInformation Commissioner's Office, Wilmslow, UK.
Carl WiperInformation Commissioner's Office, Wilmslow, UK.
Malcolm OswaldSchool of Law, Faculty of Humanities, The University of Manchester, Manchester, UK.
Niels PeekCentre for Health Informatics, Division of Informatics, Imaging and Data Science, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK.ORCID 0000-0002-6393-9969
Manchester Academic Health Science Centre · GBUniversity of Manchester · GB

Funding

Department of Health
6 · The paper itself

Abstract

objectiveTo investigate how the general public trades off explainability versus accuracy of artificial intelligence (AI) systems and whether this differs between healthcare and non-healthcare scenarios. MATERIALS AND

methodsCitizens' juries are a form of deliberative democracy eliciting informed judgment from a representative sample of the general public around policy questions. We organized two 5-day citizens' juries in the UK with 18 jurors each. Jurors considered 3 AI systems with different levels of accuracy and explainability in 2 healthcare and 2 non-healthcare scenarios. Per scenario, jurors voted for their preferred system; votes were analyzed descriptively. Qualitative data on considerations behind their preferences included transcribed audio-recordings of plenary sessions, observational field notes, outputs from small group work and free-text comments accompanying jurors' votes; qualitative data were analyzed thematically by scenario, per and across AI systems.

resultsIn healthcare scenarios, jurors favored accuracy over explainability, whereas in non-healthcare contexts they either valued explainability equally to, or more than, accuracy. Jurors' considerations in favor of accuracy regarded the impact of decisions on individuals and society, and the potential to increase efficiency of services. Reasons for emphasizing explainability included increased opportunities for individuals and society to learn and improve future prospects and enhanced ability for humans to identify and resolve system biases.

conclusionCitizens may value explainability of AI systems in healthcare less than in non-healthcare domains and less than often assumed by professionals, especially when weighed against system accuracy. The public should therefore be actively consulted when developing policy on AI explainability.

Indexed as

Artificial IntelligenceCommunity ParticipationDecision MakingDelivery of Health CareHumansartificial intelligencechoice behavior/ethicscitizens’ jury, public opinionqualitative research

Identifiers

PMID34333646
PMCPMC8522832
OpenAlexW3192023667

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.