ArticleJournal of the Medical Library Association : JMLA2019
Errors in search strategies used in systematic reviews and their effects on information retrieval.
Article in Journal of the Medical Library Association : JMLA, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 71 papers, 18 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
71 citing papers in PubMed, 18 syntheses or guidelines pooled it.
- A systematic review of factors contributing to partners' negative birth experiences.BMC pregnancy and childbirth · 2026Pooled it
- Impact of double versus single blastocyst biopsy and vitrification on clinical and neonatal outcomes in PGT cycles: A systematic review and meta-analysis of embryo retesting.Acta obstetricia et gynecologica Scandinavica · 2026Pooled it
- Does Adjuvant Metformin Reduce Olanzapine-Induced Metabolic Adverse Effects in Patients Diagnosed With Schizophrenia.Neuropsychopharmacology reports · 2025Pooled it
- Health risk behaviours, mental health and HbA1c: an overview of reviews of observational studies.BMJ open · 2025Pooled it
- Enhancing digital readiness and capability in healthcare: a systematic review of interventions, barriers, and facilitators.BMC health services research · 2025Pooled it
- Postbiotics and Dental Caries: A Systematic Review.Clinical and experimental dental research · 2025Pooled it
- Teleintervention's effects on breastfeeding in low-income women in high income countries: a systematic review and meta-analysis.International breastfeeding journal · 2024Pooled it
- Changes in soil microbial communities after exposure to neonicotinoids: A systematic review.Environmental microbiology reports · 2023Pooled it
- An appraisal of the methodology and quality of evidence of systematic reviews on the efficacy of prone positional ventilation in adult patients with acute respiratory distress syndrome: an umbrella review.Internal and emergency medicine · 2023Pooled it
- Global epidemiology of breast cancer based on risk factors: a systematic review.Frontiers in oncology · 2023Pooled it
- What are the barriers and facilitators to self-management of chronic conditions reported by women? A systematic review.BMJ open · 2022Pooled it
- A Systematic Review on the Biomechanics of Breakfall Technique (Ukemi) in Relation to Injury in Judo within the Adult Judoka Population.International journal of environmental research and public health · 2022Pooled it
- Association between Noise Annoyance and Mental Health Outcomes: A Systematic Review and Meta-Analysis.International journal of environmental research and public health · 2022Pooled it
- What are the highest yielding search strategy terms for systematic reviews in atopic dermatitis? A systematic review.Archives of dermatological research · 2021Pooled it
- Symptom Clusters in Head and Neck Cancer: A Systematic Review and Conceptual Model.Seminars in oncology nursing · 2021Pooled it
- Should low-quality evidence dominate high-level evidence? A systematic review and meta-analysis of systematic reviews of musculoskeletal physical therapy interventions.The Journal of manual & manipulative therapy · 2021Pooled it
- Systematic Review of Sex and Gender Effects in Traumatic Brain Injury: Equity in Clinical and Functional Outcomes.Frontiers in neurology · 2021Pooled it
- Cardiovascular morbidity, diabetes and cancer risk among children and adolescents with severe obesity.Cardiovascular diabetology · 2020Pooled it
- Improving peer review of systematic reviews and related review types by involving librarians and information specialists as methodological peer reviewers: a randomised controlled trial.BMJ evidence-based medicine · 2025Trial
- Implementation determinants and outcomes of artificial intelligence in surgical healthcare: a systematic review protocol.BMJ open · 2026Article
11 more citing papers are in PubMed but not listed here.
Corrections and comments
- Commented on by
Authors and funding
3 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
objectivesErrors in search strategies negatively affect the quality and validity of systematic reviews. The primary objective of this study was to evaluate searches performed in MEDLINE/PubMed to identify errors and determine their effects on information retrieval.
methodsA PubMed search was conducted using the systematic review filter to identify articles that were published in January of 2018. Systematic reviews or meta-analyses were selected from a systematic search for literature containing reproducible and explicit search strategies in MEDLINE/PubMed. Data were extracted from these studies related to ten types of errors and to the terms and phrases search modes.
resultsThe study included 137 systematic reviews in which the number of search strategies containing some type of error was very high (92.7%). Errors that affected recall were the most frequent (78.1%), and the most common search errors involved missing terms in both natural language and controlled language and those related to Medical Subject Headings (MeSH) search terms and the non-retrieval of their more specific terms.
conclusionsTo improve the quality of searches and avoid errors, it is essential to plan the search strategy carefully, which includes consulting the MeSH database to identify the concepts and choose all appropriate terms, both descriptors and synonyms, and combining search techniques in the free-text and controlled-language fields, truncating the terms appropriately to retrieve all their variants.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.