Evidence map›Paper›PMID 41716537›Full record

ArticleCochrane evidence synthesis and methods2026

Sensitivity and Precision of Search Strategies Built Using a Text-Mining Word Frequency Tool (PubReMiner) Compared to Current Best Practice for Building Search Strategies: A Study Within a Review (SWAR).

Andrew Dullea, Marie Carrigan, Lydia O'Sullivan, Isabelle Delaunois, Helen Clark, Martin Boudou, Martina Giusti, Kieran A Walsh, Patricia Harrington, Susan M Smith and 1 more

Abstract read
In one paragraph

Article in Cochrane evidence synthesis and methods, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Andrew DulleaDiscipline of Public Health & Primary Care, School of Medicine, Trinity College Dublin, The University of Dublin Dublin Co. Dublin Ireland.ORCID https://orcid.org/0000-0003-0089-983X
Marie CarriganHealth Technology Assessment Directorate, Health Information and Quality Authority Mahon Co. Cork Ireland.ORCID https://orcid.org/0000-0002-2940-0054
Lydia O'SullivanHealth Technology Assessment Directorate, Health Information and Quality Authority Mahon Co. Cork Ireland.ORCID https://orcid.org/0000-0002-7131-5048
Isabelle DelaunoisEuropean Food Safety Authority Parma Italy.ORCID https://orcid.org/0000-0003-2547-2605
Helen ClarkHSE Health Library Ireland, Sligo University Hospital Sligo Co. Sligo Ireland.ORCID https://orcid.org/0009-0005-1429-8439
Martin BoudouHealth Technology Assessment Directorate, Health Information and Quality Authority Mahon Co. Cork Ireland.ORCID https://orcid.org/0000-0002-2849-3172
Martina GiustiDepartment of Experimental and Clinical Medicine University of Florence (Università degli Studi di Firenze) Florence Tuscany Italy.ORCID https://orcid.org/0000-0001-7942-2393
Kieran A WalshHealth Technology Assessment Directorate, Health Information and Quality Authority Mahon Co. Cork Ireland.ORCID https://orcid.org/0000-0002-4386-3012
Patricia HarringtonHealth Technology Assessment Directorate, Health Information and Quality Authority Mahon Co. Cork Ireland.ORCID https://orcid.org/0000-0003-1774-4420
Susan M SmithDiscipline of Public Health & Primary Care, School of Medicine, Trinity College Dublin, The University of Dublin Dublin Co. Dublin Ireland.ORCID https://orcid.org/0000-0001-6027-2727
Máirín RyanHealth Technology Assessment Directorate, Health Information and Quality Authority Mahon Co. Cork Ireland.ORCID https://orcid.org/0000-0002-3145-0878

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Objective: PubReMiner is a text-mining tool that analyses a seed set of citations to assess word frequency in titles, abstracts, and Medical Subject Headings (MeSH). This study aimed to determine the sensitivity and precision of search strategies developed using the PubReMiner tool compared to conventional search strategies developed by a librarian at our institution. Methods: Twelve consecutive reviews conducted at our center were included from September 2023 to January 2025. These reviews included various types of evidence synthesis, including rapid reviews and systematic reviews, covering a variety of topics. One librarian developed a comprehensive search strategy, which included a conventional MEDLINE search for each review. Separately, two librarians independently developed MEDLINE search strategies using PubReMiner-generated word frequency tables (PubReMiner 1 and PubReMiner 2). All search strategies were constructed by experienced librarians using predefined work instructions. Primary outcomes were sensitivity and precision. Secondary outcomes included the number needed to read, the number of unique references retrieved, and the time taken to construct each strategy. Results: Sensitivity of PubReMiner strategies was generally lower than that of conventional strategies; however, in one review, PubReMiner achieved a higher sensitivity (83.87%) than the conventional strategy (58.06%). Only the sensitivity outcome showed a statistically significant difference between search methods (Friedman test Conclusion: While PubReMiner offers efficiency advantages, its inconsistent performance in retrieving relevant studies suggests that it should not replace conventional search strategies. The study illustrates the value of multi-review SWARs in producing evidence that informs evidence synthesis practices.

Indexed as

information retrievalstudy within a reviewSWARsystematic search methodstext‐mining

Identifiers

PMID41716537
PMCPMC12915468

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.