Evidence map›Paper›PMID 35197038›Full record

SynthesisBMC complementary medicine and therapies2022

Methodological quality of systematic reviews on Chinese herbal medicine: a methodological survey.

Andy K L Cheung, Charlene H L Wong, Leonard Ho, Irene X Y Wu, Fiona Y T Ke, Vincent C H Chung

Abstract readMeta-Analysis
In one paragraph

Synthesis in BMC complementary medicine and therapies, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
  4. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Andy K L Cheung *Jockey Club School of Public Health and Primary Care, The Chinese University of Hong Kong, Shatin, Hong Kong.
Charlene H L WongJockey Club School of Public Health and Primary Care, The Chinese University of Hong Kong, Shatin, Hong Kong.
Leonard Ho *School of Chinese Medicine, The Chinese University of Hong Kong, Shatin, Hong Kong.
Irene X Y Wu5/F, Xiangya School of Public Health, Central South University, 238 Shang-Ma-Yuan-Ling Alley, Kai-Fu District, Changsha, Hunan, China. irenexywu@csu.edu.cn.
Fiona Y T KeJockey Club School of Public Health and Primary Care, The Chinese University of Hong Kong, Shatin, Hong Kong.
Vincent C H ChungJockey Club School of Public Health and Primary Care, The Chinese University of Hong Kong, Shatin, Hong Kong.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundSystematic reviews (SRs) synthesise the best evidence of effectiveness and safety on Chinese herbal medicine (CHM). Decision-making should be supported by the high-quality evidence of prudently conducted SRs, but the trustworthiness of conclusions may be limited by poor methodological rigour.

methodsThis survey aimed to examine the methodological quality of a representative sample of SRs on CHM published during January 2018 to March 2020. We conducted literature search in Cochrane Database of Systematic Reviews, MEDLINE via Ovid, and EMBASE via Ovid. Eligible SRs must be in Chinese or English with at least one meta-analysis on the treatment effect of any CHM documented in the 2015 Chinese Pharmacopoeia. Two reviewers extracted the bibliographical characteristics of SRs and appraised their methodological quality using AMSTAR 2 (Assessing the Methodological Quality of Systematic Reviews 2). The associations between bibliographical characteristics and methodological quality were investigated using Kruskal-Wallis tests and Spearman's rank correlation coefficients.

resultsWe sampled and appraised one hundred forty-eight SRs. Overall, one (0.7%) was of high methodological quality; zero (0%), four (2.7%), and one-hundred forty-three (96.6%) SRs were of moderate, low, and critically-low quality. Only thirteen SRs (8.8%) provided a pre-defined protocol; none (0%) provided justifications for including particular primary study designs; six (4.1%) conducted a comprehensive literature search; two (1.4%) provided a list of excluded studies; nine (6.1%) undertook meta-analysis with appropriate methods; and seven (4.7%) reported funding sources of included primary studies. Cochrane reviews had higher overall quality than non-Cochrane reviews (P < 0.001). SRs with European funding support were less likely to have critically-low quality when compared with their counterparts (P = 0.020). SRs conducted by more authors (r

conclusionsOur results indicated that the methodological quality of SRs on CHM is low. Future authors should enhance the methodological quality through registering a priori protocols, justifying selection of study designs, conducting comprehensive literature search, providing a list of excluded studies with rationales, using appropriate method for meta-analyses, and reporting funding sources among primary studies.

Indexed as

Drugs, Chinese HerbalDatabases, FactualResearch DesignSurveys and QuestionnairesSystematic Reviews as TopicDrugs, Chinese HerbalDrugs, Chinese herbalEvidence-based medicineMedicine, Chinese traditionalMeta-analysisReview literature as topicSystematic review

Identifiers

PMID35197038
PMCPMC8867833

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.