Evidence map›Paper›PMID 33539585›Full record

SynthesisThe Cochrane database of systematic reviews2020

Tracking health commodity inventory and notifying stock levels via mobile devices: a mixed methods systematic review.

Smisha Agarwal, Claire Glenton, Nicholas Henschke, Tigest Tamrat, Hanna Bergman, Marita S Fønhus, Garrett L Mehl, Simon Lewin

Open access · greenAbstract readSystematic Review
In one paragraph

Synthesis in The Cochrane database of systematic reviews, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 25 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
25citing papers in PubMed, 2 pooled it
4.0field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

25 citing papers in PubMed, 2 syntheses or guidelines pooled it, 34 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Reducing inequities in access to postpartum hemorrhage prevention: Reframing advance distribution of misoprostol as a test case for health system responsiveness and adaptation.International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics · 2026
    Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Review
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 4 institutions in 5 countries.

Smisha AgarwalDepartment of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, Maryland (MD), USA.
Claire GlentonNorwegian Institute of Public Health, Oslo, Norway.
Nicholas HenschkeCochrane Response, Cochrane, London, UK.
Tigest TamratDepartment of Sexual and Reproductive Health, World Health Organization, Geneva, Switzerland.
Hanna BergmanCochrane Response, Cochrane, London, UK.
Marita S FønhusNorwegian Institute of Public Health, Oslo, Norway.
Garrett L MehlDepartment of Sexual and Reproductive Health, World Health Organization, Geneva, Switzerland.
Simon LewinNorwegian Institute of Public Health, Oslo, Norway.
Norwegian Institute of Public Health · NOCochrane · GBWorld Health Organization · CHJohns Hopkins University · US

Funding

World Health Organization 001
6 · The paper itself

Abstract

backgroundHealth systems need timely and reliable access to essential medicines and health commodities, but problems with access are common in many settings. Mobile technologies offer potential low-cost solutions to the challenge of drug distribution and commodity availability in primary healthcare settings. However, the evidence on the use of mobile devices to address commodity shortages is sparse, and offers no clear way forward.

objectivesPrimary objective To assess the effects of strategies for notifying stock levels and digital tracking of healthcare-related commodities and inventory via mobile devices across the primary healthcare system Secondary objectives To describe what mobile device strategies are currently being used to improve reporting and digital tracking of health commodities To identify factors influencing the implementation of mobile device interventions targeted at reducing stockouts of health commodities SEARCH

methodsWe searched CENTRAL, MEDLINE Ovid, Embase Ovid, Global Index Medicus WHO, POPLINE K4Health, and two trials registries in August 2019. We also searched Epistemonikos for related systematic reviews and potentially eligible primary studies. We conducted a grey literature search using mHealthevidence.org, and issued a call for papers through popular digital health communities of practice. Finally, we conducted citation searches of included studies. We searched for studies published after 2000, in any language. SELECTION CRITERIA: For the primary objective, we included individual and cluster-randomised trials, controlled before-after studies, and interrupted time series studies. For the secondary objectives, we included any study design, which could be quantitative, qualitative, or descriptive, that aimed to describe current strategies for commodity tracking or stock notification via mobile devices; or aimed to explore factors that influenced the implementation of these strategies, including studies of acceptability or feasibility. We included studies of all cadres of healthcare providers, including lay health workers, and others involved in the distribution of health commodities (administrative staff, managerial and supervisory staff, dispensary staff); and all other individuals involved in stock notification, who may be based in a facility or a community setting, and involved with the delivery of primary healthcare services. We included interventions aimed at improving the availability of health commodities using mobile devices in primary healthcare settings. For the primary objective, we included studies that compared health commodity tracking or stock notification via mobile devices with standard practice. For the secondary objectives, we included studies of health commodity tracking and stock notification via mobile device, if we could extract data relevant to our secondary objectives. DATA COLLECTION AND ANALYSIS: For the primary objective, two authors independently screened all records, extracted data from the included studies, and assessed the risk of bias. For the analyses of the primary objectives, we reported means and proportions where appropriate. We used the GRADE approach to assess the certainty of the evidence, and prepared a 'Summary of findings' table. For the secondary objective, two authors independently screened all records, extracted data from the included studies, and applied a thematic synthesis approach to synthesise the data. We assessed methodological limitation using the Ways of Evaluating Important and Relevant Data (WEIRD) tool. We used the GRADE-CERQual approach to assess our confidence in the evidence, and prepared a 'Summary of qualitative findings' table. MAIN

resultsPrimary objective For the primary objective, we included one controlled before-after study conducted in Malawi. We are uncertain of the effect of cStock plus enhanced management, or cStock plus effective product transport on the availability of commodities, quality and timeliness of stock management, and satisfaction and acceptability, because we assessed the evidence as very low-certainty. The study did not report on resource use or unintended consequences. Secondary objective For the secondary objectives, we included 16 studies, using a range of study designs, which described a total of eleven interventions. All studies were conducted in African (Tanzania, Kenya, Malawi, Ghana, Ethiopia, Cameroon, Zambia, Liberia, Uganda, South Africa, and Rwanda) and Asian (Pakistan and India) countries. Most of the interventions aimed to make data about stock levels and potential stockouts visible to managers, who could then take corrective action to address them. We identified several factors that may influence the implementation of stock notification and tracking via mobile device. These include challenges tied to infrastructural issues, such as poor access to electricity or internet, and broader health systems issues, such as drug shortages at the national level which cannot be mitigated by interventions at the primary healthcare level (low confidence). Several factors were identified as important, including strong partnerships with local authorities, telecommunication companies, technical system providers, and non-governmental organizations (very low confidence); availability of stock-level data at all levels of the health system (low confidence); the role of supportive supervision and responsive management (moderate confidence); familiarity and training of health workers in the use of the digital devices (moderate confidence); availability of technical programming expertise for the initial development and ongoing maintenance of the digital systems (low confidence); incentives, such as phone credit for personal use, to support regular use of the system (low confidence); easy-to-use systems built with user participation (moderate confidence); use of basic or personal mobile phones to support easier adoption (low confidence); consideration for software features, such as two-way communication (low confidence); and data availability in an easy-to-use format, such as an interactive dashboard (moderate confidence). AUTHORS'

conclusionsWe need more, well-designed, controlled studies comparing stock notification and commodity management via mobile devices with paper-based commodity management systems. Further studies are needed to understand the factors that may influence the implementation of such interventions, and how implementation considerations differ by variations in the intervention.

Indexed as

Computers, HandheldBiasCell PhoneControlled Before-After StudiesDrugs, EssentialEquipment and Supplies, HospitalHealth PersonnelHumansInterrupted Time Series AnalysisInventories, HospitalMaterials Management, HospitalNon-Randomized Controlled Trials as TopicRandomized Controlled Trials as TopicDrugs, Essential

Identifiers

PMID33539585
PMCPMC8094928
OpenAlexW3107647218

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.