ArticleBMC health services research2025
Development of key performance indicators for a telemedicine setting in Egypt using an electronic modified Delphi approach.
Article in BMC health services research, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
1 citing paper in PubMed.
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
6 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundPerformance measurement is crucial for maintaining quality of care in health systems, and so telemedicine is no exception. Key Performance Indicators (KPIs) are some of the primary tools for performance measurement. While there are many global studies on telemedicine quality, studies that are done specifically on indicators are limited. Based on this, the purpose of this study is to develop KPIs for evaluating the performance of telemedicine settings.
methodsA consensus-based methodological study employing the Delphi method was conducted. The study was conducted in Ain Shams Virtual Hospital (AVH). It started with defining the selection criteria to be used in Delphi method. Then a review of scientific sources was carried out to enlist the potential indicators of telemedicine. An electronic modified Delphi technique was then used. The panel members were invited to rate the indicators on a 10-point Likert scale, and subsequently, the experts then reconsidered their previous voting in the light of the aggregated results. The agreement was reached as the indicator showed a 70% level of agreement. Cohen Kappa (K) was calculated to show the percentage of agreement between the two rounds.
resultsThe multi-voting process established three selection criteria for indicators: clarity, feasibility, and importance. A review of research sources led to an initial list of 52 potential indicators, categorized into operations, clinical services, and customer satisfaction. The Delphi method was carried out in two rounds, with expert participation rates of 35% in the first round, and 80% in the second. In the end, 31 indicators achieved the 70% agreement level, with the majority falling under the operations category, while all customer satisfaction indicators were selected. Cohen's Kappa analysis showed that nearly 85% of comparisons between the two rounds demonstrated substantial agreement.
conclusionsThis study identifies a thorough collection of indicators that offers a valuable tool for enhancing quality in telemedicine settings. The indicators cover important domains in telemedicine services, such as: access, utilization, system efficiency, and customer satisfaction. Future directions should include piloting these KPIs in telemedicine systems and assessing the acceptability of their application.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.