Evidence map›Paper›PMID 36380367›Full record

ArticleSystematic reviews2022

Meta-research evaluating redundancy and use of systematic reviews when planning new studies in health research: a scoping review.

Hans Lund, Karen A Robinson, Ane Gjerland, Hanna Nykvist, Thea Marie Drachen, Robin Christensen, Carsten Bogh Juhl, Gro Jamtvedt, Monica Nortvedt, Merete Bjerrum and 4 more

Abstract readScoping Review
In one paragraph

Article in Systematic reviews, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Evidence-based research.Systematic reviews · 2024
    Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Hans LundSection Evidence-Based Practice, Department for Health and Function, Western Norway University of Applied Sciences, Inndalsveien 28, P.O.Box 7030, N-5020, Bergen, Norway. Hans.lund@hvl.no.ORCID 0000-0001-6847-8324
Karen A RobinsonSection Evidence-Based Practice, Department for Health and Function, Western Norway University of Applied Sciences, Inndalsveien 28, P.O.Box 7030, N-5020, Bergen, Norway.ORCID 0000-0003-1021-7820
Ane GjerlandSection Evidence-Based Practice, Department for Health and Function, Western Norway University of Applied Sciences, Inndalsveien 28, P.O.Box 7030, N-5020, Bergen, Norway.ORCID 0000-0001-7496-9568
Hanna NykvistSection Evidence-Based Practice, Department for Health and Function, Western Norway University of Applied Sciences, Inndalsveien 28, P.O.Box 7030, N-5020, Bergen, Norway.ORCID 0000-0002-1642-2414
Thea Marie DrachenResearch and Analysis Department, University Library of Southern Denmark, Odense, Denmark.ORCID 0000-0003-4760-5536
Robin ChristensenSection for Biostatistics and Evidence-Based Research, the Parker Institute, Bispebjerg and Frederiksberg Hospital, Copenhagen, Denmark.ORCID 0000-0002-6600-0631
Carsten Bogh JuhlDepartment of Sports Science and Clinical Biomechanics, University of Southern Denmark, Odense, Denmark.ORCID 0000-0001-8456-5364
Gro JamtvedtFaculty of Health Sciences, OsloMet, Oslo, Norway.ORCID 0000-0001-6013-7429
Monica NortvedtFaculty of Health and Social Science, Western Norway University of Applied Sciences, Bergen, Norway.ORCID 0000-0002-1859-6071
Merete BjerrumResearch Unit of Nursing and healthcare, Institute of Public Health, Health, Aarhus University, Aarhus, Denmark.ORCID 0000-0001-8249-4021
Matt WestmoreHealth Research Authority, NHS, London, UK.ORCID 0000-0003-3784-0380
Jennifer YostM. Louise Fitzpatrick College of Nursing, Villanova University, Villanova, PA, USA.ORCID 0000-0002-3170-1956
Klara BrunnhuberClinical Solutions, Elsevier Ltd., 125 London Wall, London, EC2Y 5AS, UK.ORCID 0000-0001-6787-4405
Evidence-Based Research Network

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundSeveral studies have documented the production of wasteful research, defined as research of no scientific importance and/or not meeting societal needs. We argue that this redundancy in research may to a large degree be due to the lack of a systematic evaluation of the best available evidence and/or of studies assessing societal needs.

objectivesThe aim of this scoping review is to (A) identify meta-research studies evaluating if redundancy is present within biomedical research, and if so, assessing the prevalence of such redundancy, and (B) to identify meta-research studies evaluating if researchers had been trying to minimise or avoid redundancy. ELIGIBILITY CRITERIA: Meta-research studies (empirical studies) were eligible if they evaluated whether redundancy was present and to what degree; whether health researchers referred to all earlier similar studies when justifying and designing a new study and/or when placing new results in the context of earlier similar trials; and whether health researchers systematically and transparently considered end users' perspectives when justifying and designing a new study. SOURCES OF EVIDENCE: The initial overall search was conducted in MEDLINE, Embase via Ovid, CINAHL, Web of Science, Social Sciences Citation Index, Arts & Humanities Citation Index, and the Cochrane Methodology Register from inception to June 2015. A 2nd search included MEDLINE and Embase via Ovid and covered January 2015 to 26 May 2021. No publication date or language restrictions were applied. CHARTING

methodsCharting methods included description of the included studies, bibliometric mapping, and presentation of possible research gaps in the identified meta-research.

resultsWe identified 69 meta-research studies. Thirty-four (49%) of these evaluated the prevalence of redundancy and 42 (61%) studies evaluated the prevalence of a systematic and transparent use of earlier similar studies when justifying and designing new studies, and/or when placing new results in context, with seven (10%) studies addressing both aspects. Only one (1%) study assessed if the perspectives of end users had been used to inform the justification and design of a new study. Among the included meta-research studies evaluating whether redundancy was present, only two of nine health domains (medical areas) and only two of 10 research topics (different methodological types) were represented. Similarly, among the included meta-research studies evaluating whether researchers had been trying to minimise or avoid redundancy, only one of nine health domains and only one of 10 research topics were represented. CONCLUSIONS THAT RELATE TO THE REVIEW QUESTIONS AND

objectivesEven with 69 included meta-research studies, there was a lack of information for most health domains and research topics. However, as most included studies were evaluating across different domains, there is a clear indication of a high prevalence of redundancy and a low prevalence of trying to minimise or avoid redundancy. In addition, only one meta-research study evaluated whether the perspectives of end users were used to inform the justification and design of a new study. SYSTEMATIC REVIEW REGISTRATION: Protocol registered at Open Science Framework: https://osf.io/3rdua/ (15 June 2021).

Indexed as

Systematic Reviews as TopicHumansMEDLINEEvidence-based researchMeta-researchResearch on researchScoping reviewSystematicityTransparency

Identifiers

PMID36380367
PMCPMC9667610

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.