Evidence map›Paper›PMID 35388447›Full record

SynthesisApplied clinical informatics2022

Toward a Learning Health Care System: A Systematic Review and Evidence-Based Conceptual Framework for Implementation of Clinical Analytics in a Digital Hospital.

Han Chang Lim, Jodie A Austin, Anton H van der Vegt, Amir Kamel Rahimi, Oliver J Canfell, Jayden Mifsud, Jason D Pole, Michael A Barras, Tobias Hodgson, Sally Shrapnel and 1 more

Abstract readSystematic Review
In one paragraph

Synthesis in Applied clinical informatics, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
27citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

27 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Review
  5. Article
  6. VIEWER: an extensible visual analytics framework for enhancing mental healthcare.Journal of the American Medical Informatics Association : JAMIA · 2026
    Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Quality of care assessment for non-small cell lung cancer patients: transforming routine care data into a continuous improvement system.Clinical & translational oncology : official publication of the Federation of Spanish Oncology Societies and of the National Cancer Institute of Mexico · 2025
    Observational
  13. Article
  14. Review
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Han Chang LimCentre for Health Services Research, Faculty of Medicine, The University of Queensland, Herston, Brisbane, Australia.
Jodie A AustinCentre for Health Services Research, Faculty of Medicine, The University of Queensland, Herston, Brisbane, Australia.
Anton H van der VegtInformation Engineering Lab, School of Information Technology and Electrical Engineering, The University of Queensland, St Lucia, Brisbane, Australia.
Amir Kamel RahimiCentre for Health Services Research, Faculty of Medicine, The University of Queensland, Herston, Brisbane, Australia.
Oliver J CanfellCentre for Health Services Research, Faculty of Medicine, The University of Queensland, Herston, Brisbane, Australia.
Jayden MifsudCentre for Health Services Research, Faculty of Medicine, The University of Queensland, Herston, Brisbane, Australia.
Jason D PoleCentre for Health Services Research, Faculty of Medicine, The University of Queensland, Herston, Brisbane, Australia.
Michael A BarrasSchool of Pharmacy, Faculty of Health and Behavioural Sciences, The University of Queensland, PACE Precinct, Woolloongabba, Brisbane, Australia.
Tobias HodgsonUQ Business School, Faculty of Business, Economics and Law, The University of Queensland, St. Lucia, Brisbane, Australia.
Sally ShrapnelCentre for Health Services Research, Faculty of Medicine, The University of Queensland, Herston, Brisbane, Australia.
Clair M SullivanCentre for Health Services Research, Faculty of Medicine, The University of Queensland, Herston, Brisbane, Australia.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveA learning health care system (LHS) uses routinely collected data to continuously monitor and improve health care outcomes. Little is reported on the challenges and methods used to implement the analytics underpinning an LHS. Our aim was to systematically review the literature for reports of real-time clinical analytics implementation in digital hospitals and to use these findings to synthesize a conceptual framework for LHS implementation.

methodsEmbase, PubMed, and Web of Science databases were searched for clinical analytics derived from electronic health records in adult inpatient and emergency department settings between 2015 and 2021. Evidence was coded from the final study selection that related to (1) dashboard implementation challenges, (2) methods to overcome implementation challenges, and (3) dashboard assessment and impact. The evidences obtained, together with evidence extracted from relevant prior reviews, were mapped to an existing digital health transformation model to derive a conceptual framework for LHS analytics implementation.

resultsA total of 238 candidate articles were reviewed and 14 met inclusion criteria. From the selected studies, we extracted 37 implementation challenges and 64 methods employed to overcome such challenges. We identified common approaches for evaluating the implementation of clinical dashboards. Six studies assessed clinical process outcomes and only four studies evaluated patient health outcomes. A conceptual framework for implementing the analytics of an LHS was developed.

conclusionHealth care organizations face diverse challenges when trying to implement real-time data analytics. These challenges have shifted over the past decade. While prior reviews identified fundamental information problems, such as data size and complexity, our review uncovered more postpilot challenges, such as supporting diverse users, workflows, and user-interface screens. Our review identified practical methods to overcome these challenges which have been incorporated into a conceptual framework. It is hoped this framework will support health care organizations deploying near-real-time clinical dashboards and progress toward an LHS.

Indexed as

Learning Health SystemAdultData ScienceDelivery of Health CareElectronic Health RecordsHospitalsHumans

Identifiers

PMID35388447
PMCPMC8986462

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.