ReviewAMIA ... Annual Symposium proceedings. AMIA Symposium2013
Inter-observer reliability assessments in time motion studies: the foundation for meaningful clinical workflow analysis.
Review in AMIA ... Annual Symposium proceedings. AMIA Symposium, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
14 citing papers in PubMed.
- Bubble CPAP and oxygen for child pneumonia care in Malawi: a CPAP IMPACT time motion study.BMC health services research · 2019Trial
- The Road to Developing Standard Time for Efficient Nursing Care: A Time and Motion Analysis.Healthcare (Basel, Switzerland) · 2023Article
- eRegTime-Time Spent on Health Information Management in Primary Health Care Clinics Using a Digital Health Registry Versus Paper-Based Documentation: Cluster-Randomized Controlled Trial.JMIR formative research · 2022Article
- A Practical Guide to Using Time-and-Motion Methods to Monitor Compliance With Hand Hygiene Guidelines: Experience From Tanzanian Labor Wards.Global health, science and practice · 2020Article
- A review of measurement practice in studies of clinical decision support systems 1998-2017.Journal of the American Medical Informatics Association : JAMIA · 2019Review
- Resident Supervision and Patient Care: A Comparative Time Study in a Community-Academic Versus a Community Emergency Department.AEM education and training · 2019Article
- eRegTime, Efficiency of Health Information Management Using an Electronic Registry for Maternal and Child Health: Protocol for a Time-Motion Study in a Cluster Randomized Trial.JMIR research protocols · 2019Article
- Foundations for Studying Clinical Workflow: Development of a Composite Inter-Observer Reliability Assessment for Workflow Time Studies.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2019Article
- Nurses' Stress Associated with Nursing Activities and Electronic Health Records: Data Triangulation from Continuous Stress Monitoring, Perceived Workload, and a Time Motion Study.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2019Article
- An Interprofessional Approach to Clinical Workflow Evaluation Focused on the Electronic Health Record Using Time motion Study Methods.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2019Article
- Measuring the operational impact of digitized hospital records: a mixed methods study.BMC medical informatics and decision making · 2016Article
- Usability and Workflow Evaluation of "RhEumAtic Disease activitY" (READY). A Mobile Application for Rheumatology Patients and Providers.Applied clinical informatics · 2016Article
- A data-driven concept schema for defining clinical research data needs.International journal of medical informatics · 2016Article
- Understanding and Visualizing Multitasking and Task Switching Activities: A Time Motion Study to Capture Nursing Workflow.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2016Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
6 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
Understanding clinical workflow is critical for researchers and healthcare decision makers. Current workflow studies tend to oversimplify and underrepresent the complexity of clinical workflow. Continuous observation time motion studies (TMS) could enhance clinical workflow studies by providing rich quantitative data required for in-depth workflow analyses. However, methodological inconsistencies have been reported in continuous observation TMS, potentially reducing the validity of TMS' data and limiting their contribution to the general state of knowledge. We believe that a cornerstone in standardizing TMS is to ensure the reliability of the human observers. In this manuscript we review the approaches for inter-observer reliability assessment (IORA) in a representative sample of TMS focusing on clinical workflow. We found that IORA is an uncommon practice, inconsistently reported, and often uses methods that provide partial and overestimated measures of agreement. Since a comprehensive approach to IORA is yet to be proposed and validated, we provide initial recommendations for IORA reporting in continuous observation TMS.
Indexed as
Identifiers
24551381PMC3900222What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.