Evidence map›Paper›PMID 37386371›Full record

SynthesisBMC medical research methodology2023

Evaluation of reporting quality of cohort studies using real-world data based on RECORD: systematic review.

Ran Zhao, Wen Zhang, ZeDan Zhang, Chang He, Rong Xu, XuDong Tang, Bin Wang

Abstract readSystematic Review
In one paragraph

Synthesis in BMC medical research methodology, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed.

  1. Reporting Quality for Comorbidity Adjustment in Studies Using Korean Health Insurance Claim Data: A Scoping Review.Journal of preventive medicine and public health = Yebang Uihakhoe chi · 2026
    Article
  2. Article
  3. Article
  4. Article
  5. ESMO Guidance for Reporting Oncology real-World evidence (GROW).ESMO real world data and digital oncology · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Ran Zhao *Institute of Information on Traditional Chinese Medicine, China Academy of Chinese Medical Sciences, Beijing, China.
Wen Zhang *Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China.
ZeDan ZhangTraditional Chinese Medicine Data Center, China Academy of Chinese Medical Sciences, Beijing, China.
Chang HeInstitute of Information on Traditional Chinese Medicine, China Academy of Chinese Medical Sciences, Beijing, China.
Rong XuGuang'anmeng Hospital, China Academy of Chinese Medical Sciences, Beijing, China.
XuDong TangChina Academy of Chinese Medical Sciences, Beijing, China. txdly@sina.com.
Bin WangInstitute of Information on Traditional Chinese Medicine, China Academy of Chinese Medical Sciences, Beijing, China. wangbin135@139.com.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveReal-world data (RWD) and real-world evidence (RWE) have been paid more and more attention in recent years. We aimed to evaluate the reporting quality of cohort studies using real-world data (RWD) published between 2013 and 2021 and analyze the possible factors.

methodsWe conducted a comprehensive search in Medline and Embase through the OVID interface for cohort studies published from 2013 to 2021 on April 29, 2022. Studies aimed at comparing the effectiveness or safety of exposure factors in the real-world setting were included. The evaluation was based on the REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement. Agreement for inclusion and evaluation was calculated using Cohen's kappa. Pearson chi-square test or Fisher's exact test and Mann-Whitney U test were used to analyze the possible factors, including the release of RECORD, journal IFs, and article citations. Bonferroni's correction was conducted for multiple comparisons. Interrupted time series analysis was performed to display the changes in report quality over time.

results187 articles were finally included. The mean ± SD of the percentage of adequately reported items in the 187 articles was 44.7 ± 14.3 with a range of 11.1-87%. Of 23 items, the adequate reporting rate of 10 items reached 50%, and the reporting rate of some vital items was inadequate. After Bonferroni's correction, the reporting of only one item significantly improved after the release of RECORD and there was no significant improvement in the overall report quality. For interrupted time series analysis, there were no significant changes in the slope (p = 0.42) and level (p = 0.12) of adequate reporting rate. The journal IFs and citations were respectively related to 2 areas and the former significantly higher in high-reporting quality articles.

conclusionThe endorsement of the RECORD cheklist was generally inadequate in cohort studies using RWD and has not improved in recent years. We encourage researchers to endorse relevant guidelines when utilizing RWD for research.

Indexed as

Research PersonnelCohort StudiesHumansInterrupted Time Series AnalysisMEDLINEStatistics, NonparametricCohort studiesReal world dataReal world evidenceReporting qualityThe RECORD statement

Identifiers

PMID37386371
PMCPMC10308622

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.