ArticleJMIR medical informatics2022
The Science of Learning Health Systems: Scoping Review of Empirical Research.
Article in JMIR medical informatics, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 52 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
52 citing papers in PubMed, 1 synthesis or guideline pooled it.
- Implementation strategies and outcome measures for advancing learning health systems: a mixed methods systematic review.Health research policy and systems · 2023Pooled it
- Effectiveness of a virtual quality improvement training program to improve reach of weight management programs within a large health system.Health services research · 2024Trial
- Harnessing Potential: A Systematic Investigation of How and Why Learning Happens in a Health System.Learning health systems · 2026Article
- Development of the Learning Health Systems Toolkit: A Collaborative Effort to Bridge Concept and Practice.Learning health systems · 2026Article
- Ambient AI Scribes as Emerging Infrastructure in the Learning Health System.Learning health systems · 2026Article
- Supporting Cultural and Learning Enablers for a Learning Health System (SCALE): A Program Theory Approach.Learning health systems · 2026Article
- Exploring Barriers, Enablers, and Strategies for Implementing Learning Health System Projects in Healthcare Organizations: A Multilevel Analysis in an Australian Setting.Learning health systems · 2026Article
- Available guidance for ethical challenges in learning health systems: an integrative literature review.Health research policy and systems · 2026Review
- Too deductive too soon? Toward an inductive renewal of implementation science.Implementation science : IS · 2026Article
- Inishowen Child and Adolescent Mental Health Service: Developing a Learning Health Microsystem.Learning health systems · 2026Article
- Integrating systems thinking and implementation science in biomedical informatics research.JAMIA open · 2026Review
- The Monash learning health system maturity matrix: codesign of a tool to measure and guide improvement in complex health system behaviour.BMC health services research · 2026Article
- What does it take to support community-engaged research in an academic medical center? A mixed-methods study of community and academic perspectives.Journal of clinical and translational science · 2026Article
- Convergence mapping analysis of interdisciplinary linkages in health services management.BMC health services research · 2025Article
- Learning about learning health systems: Strengthening theory through continuous evaluation and improvement.Learning health systems · 2025Article
- Charting progress in learning health systems: A systematic review of 5 years of definitions, models, and frameworks.Learning health systems · 2025Article
- A learning health system model for addressing substance use: Denver Health Center for Addiction Medicine.Learning health systems · 2025Article
- Cyclical medication management interventions in health care settings: A systematic review.Learning health systems · 2025Article
- Transforming the future of health: building learning health systems across the globe.Health affairs scholar · 2025Article
- Data-Driven Defragmentation: Achieving Value-Based Sarcoma and Rare Cancer Care Through Integrated Care Pathway Mapping.Journal of personalized medicine · 2025Review
Corrections and comments
- Erratum issued
Authors and funding
10 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundThe development and adoption of a learning health system (LHS) has been proposed as a means to address key challenges facing current and future health care systems. The first review of the LHS literature was conducted 5 years ago, identifying only a small number of published papers that had empirically examined the implementation or testing of an LHS. It is timely to look more closely at the published empirical research and to ask the question, Where are we now? 5 years on from that early LHS review.
objectiveThis study performed a scoping review of empirical research within the LHS domain. Taking an "implementation science" lens, the review aims to map out the empirical research that has been conducted to date, identify limitations, and identify future directions for the field.
methodsTwo academic databases (PubMed and Scopus) were searched using the terms "learning health* system*" for papers published between January 1, 2016, to January 31, 2021, that had an explicit empirical focus on LHSs. Study information was extracted relevant to the review objective, including each study's publication details; primary concern or focus; context; design; data type; implementation framework, model, or theory used; and implementation determinants or outcomes examined.
resultsA total of 76 studies were included in this review. Over two-thirds of the studies were concerned with implementing a particular program, system, or platform (53/76, 69.7%) designed to contribute to achieving an LHS. Most of these studies focused on a particular clinical context or patient population (37/53, 69.8%), with far fewer studies focusing on whole hospital systems (4/53, 7.5%) or on other broad health care systems encompassing multiple facilities (12/53, 22.6%). Over two-thirds of the program-specific studies utilized quantitative methods (37/53, 69.8%), with a smaller number utilizing qualitative methods (10/53, 18.9%) or mixed-methods designs (6/53, 11.3%). The remaining 23 studies were classified into 1 of 3 key areas: ethics, policies, and governance (10/76, 13.2%); stakeholder perspectives of LHSs (5/76, 6.6%); or LHS-specific research strategies and tools (8/76, 10.5%). Overall, relatively few studies were identified that incorporated an implementation science framework.
conclusionsAlthough there has been considerable growth in empirical applications of LHSs within the past 5 years, paralleling the recent emergence of LHS-specific research strategies and tools, there are few high-quality studies. Comprehensive reporting of implementation and evaluation efforts is an important step to moving the LHS field forward. In particular, the routine use of implementation determinant and outcome frameworks will improve the assessment and reporting of barriers, enablers, and implementation outcomes in this field and will enable comparison and identification of trends across studies.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.