Evidence map›Paper›PMID 36996044›Full record

ArticleJournal of medical Internet research2023

Automated Monitoring of Adherence to Evidenced-Based Clinical Guideline Recommendations: Design and Implementation Study.

Gregor Lichtner, Claudia Spies, Carlo Jurth, Thomas Bienert, Anika Mueller, Oliver Kumpf, Vanessa Piechotta, Nicole Skoetz, Monika Nothacker, Martin Boeker and 2 more

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed.

  1. Review
  2. Article
  3. A comprehensive survey of AI agents in healthcare.Journal of biomedical informatics · 2026
    Review
  4. Review
  5. Article
  6. Article
  7. Observational
  8. Article
  9. [Functional requirements of patient data management systems in intensive care medicine].Medizinische Klinik, Intensivmedizin und Notfallmedizin · 2024
    Review
  10. Review
  11. Article
  12. Review
  13. Ten Topics to Get Started in Medical Informatics Research.Journal of medical Internet research · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Gregor LichtnerDepartment of Anesthesia, Critical Care, Emergency and Pain Medicine, Universitätsmedizin Greifswald, Greifswald, Germany.ORCID 0000-0002-5890-1958
Claudia SpiesDepartment of Anesthesiology and Operative Intensive Care Medicine, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany.ORCID 0000-0002-1062-0495
Carlo JurthDepartment of Anesthesiology and Operative Intensive Care Medicine, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany.ORCID 0000-0002-0890-312X
Thomas BienertDepartment of Anesthesiology and Operative Intensive Care Medicine, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany.ORCID 0000-0002-3775-8320
Anika MuellerDepartment of Anesthesiology and Operative Intensive Care Medicine, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany.ORCID 0000-0002-6859-7080
Oliver KumpfDepartment of Anesthesiology and Operative Intensive Care Medicine, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany.ORCID 0000-0001-7891-8872
Vanessa PiechottaEvidence-based Medicine, Department I of Internal Medicine, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany.ORCID 0000-0003-1422-6898
Nicole SkoetzEvidence-based Medicine, Department I of Internal Medicine, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany.ORCID 0000-0003-4744-6192
Monika NothackerInstitute for Medical Knowledge Management, Association of the Scientific Medical Societies, University of Marburg, Marburg, Germany.ORCID 0000-0003-4928-7391
Martin BoekerInstitute for Artificial Intelligence and Informatics in Medicine, Medical Center rechts der Isar, School of Medicine, Technical University of Munich, Munich, Germany.ORCID 0000-0003-2972-2042
Joerg J MeerpohlInstitute for Evidence in Medicine, Medical Center & Faculty of Medicine, University of Freiburg, Freiburg, Germany.ORCID 0000-0002-1333-5403
Falk von DincklageDepartment of Anesthesia, Critical Care, Emergency and Pain Medicine, Universitätsmedizin Greifswald, Greifswald, Germany.ORCID 0000-0002-1543-4544

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundClinical practice guidelines are systematically developed statements intended to optimize patient care. However, a gapless implementation of guideline recommendations requires health care personnel not only to be aware of the recommendations and to support their content but also to recognize every situation in which they are applicable. To not miss situations in which recommendations should be applied, computerized clinical decision support can be provided through a system that allows an automated monitoring of adherence to clinical guideline recommendations in individual patients.

objectiveThis study aims to collect and analyze the requirements for a system that allows the monitoring of adherence to evidence-based clinical guideline recommendations in individual patients and, based on these requirements, to design and implement a software prototype that integrates guideline recommendations with individual patient data, and to demonstrate the prototype's utility in treatment recommendations.

methodsWe performed a work process analysis with experienced intensive care clinicians to develop a conceptual model of how to support guideline adherence monitoring in clinical routine and identified which steps in the model could be supported electronically. We then identified the core requirements of a software system to support recommendation adherence monitoring in a consensus-based requirements analysis within the loosely structured focus group work of key stakeholders (clinicians, guideline developers, health data engineers, and software developers). On the basis of these requirements, we designed and implemented a modular system architecture. To demonstrate its utility, we applied the prototype to monitor adherence to a COVID-19 treatment recommendation using clinical data from a large European university hospital.

resultsWe designed a system that integrates guideline recommendations with real-time clinical data to evaluate individual guideline recommendation adherence and developed a functional prototype. The needs analysis with clinical staff resulted in a flowchart describing the work process of how adherence to recommendations should be monitored. Four core requirements were identified: the ability to decide whether a recommendation is applicable and implemented for a specific patient, the ability to integrate clinical data from different data formats and data structures, the ability to display raw patient data, and the use of a Fast Healthcare Interoperability Resources-based format for the representation of clinical practice guidelines to provide an interoperable, standards-based guideline recommendation exchange format.

conclusionsOur system has advantages in terms of individual patient treatment and quality management in hospitals. However, further studies are needed to measure its impact on patient outcomes and evaluate its resource effectiveness in different clinical settings. We specified a modular software architecture that allows experts from different fields to work independently and focus on their area of expertise. We have released the source code of our system under an open-source license and invite for collaborative further development of the system.

Indexed as

COVID-19COVID-19 Drug TreatmentFocus GroupsGuideline AdherenceHumansclinicalclinical decision supportclinical guideline recommendationscomputer-interpretable guidelinesCOVID-19dataevidence-based medicinemonitoringpatientprototypesystemutility

Identifiers

PMID36996044
PMCPMC10162484

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.