Evidence map›Paper›PMID 37715095›Full record

ArticleJournal of general internal medicine2023

Evaluation of Digitalisation in Healthcare and the Quantification of the "Unmeasurable".

Kathrin Cresswell, Stuart Anderson, Catherine Montgomery, Christopher J Weir, Marek Atter, Robin Williams

Abstract readEditorial
In one paragraph

Article in Journal of general internal medicine, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Kathrin CresswellUsher Institute, The University of Edinburgh, Edinburgh, UK. Kathrin.Cresswell@ed.ac.uk.ORCID 0000-0001-6634-9537
Stuart AndersonSchool of Informatics, The University of Edinburgh, Edinburgh, UK.
Catherine MontgomeryInstitute for the Study of Science, Technology and Innovation, The University of Edinburgh, Edinburgh, UK.
Christopher J WeirEdinburgh Clinical Trials Unit, Usher Institute, The University of Edinburgh, Edinburgh, UK.
Marek AtterEdinburgh Clinical Trials Unit, Usher Institute, The University of Edinburgh, Edinburgh, UK.
Robin WilliamsInstitute for the Study of Science, Technology and Innovation, The University of Edinburgh, Edinburgh, UK.

Funding

NIH HHS RP-PG-0617-20009
6 · The paper itself

Abstract

Evaluating healthcare digitalisation, where technology implementation and adoption transforms existing socio-organisational processes, presents various challenges for outcome assessments. Populations are diverse, interventions are complex and evolving over time, meaningful comparisons are difficult as outcomes vary between settings, and outcomes take a long time to materialise and stabilise. Digitalisation may also have unanticipated impacts. We here discuss the limitations of evaluating the digitalisation of healthcare, and describe how qualitative and quantitative approaches can complement each other to facilitate investment and implementation decisions. In doing so, we argue how existing approaches have focused on measuring what is easily measurable and elevating poorly chosen values to inform investment decisions. Limited attention has been paid to understanding processes that are not easily measured even though these can have significant implications for contextual transferability, sustainability and scale-up of interventions. We use what is commonly known as the McNamara Fallacy to structure our discussions. We conclude with recommendations on how we envisage the development of mixed methods approaches going forward in order to address shortcomings.

Indexed as

Delivery of Health CareResearch DesignHumans

Identifiers

PMID37715095
PMCPMC10713954

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.