Evidence map›Paper›PMID 34996370›Full record

ArticleBMC medical research methodology2022

Reporting of abstracts in studies that used routinely collected data for exploring drug treatment effects: a cross-sectional survey.

Mei Liu, Wen Wang, Mingqi Wang, Qiao He, Ling Li, Guowei Li, Lin He, Kang Zou, Xin Sun

Abstract read
In one paragraph

Article in BMC medical research methodology, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Mei Liu *Chinese Evidence-based Medicine Center and Cochrane China Center, National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China.
Wen Wang *Chinese Evidence-based Medicine Center and Cochrane China Center, National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China.
Mingqi WangChinese Evidence-based Medicine Center and Cochrane China Center, National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China.
Qiao HeChinese Evidence-based Medicine Center and Cochrane China Center, National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China.
Ling LiChinese Evidence-based Medicine Center and Cochrane China Center, National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China.
Guowei LiDepartment of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON, L8S 4L8, Canada.
Lin HeIntelligence Library Center, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China.
Kang ZouChinese Evidence-based Medicine Center and Cochrane China Center, National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China.
Xin SunChinese Evidence-based Medicine Center and Cochrane China Center, National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China. sunxin@wchscu.cn.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundIn recent years, studies that used routinely collected data (RCD), such as electronic medical records and administrative claims, for exploring drug treatment effects, including effectiveness and safety, have been increasingly published. Abstracts of such studies represent a highly attended source for busy clinicians or policy-makers, and are important for indexing by literature database. If less clearly presented, they may mislead decisions or indexing. We thus conducted a cross-sectional survey to systematically examine how the abstracts of such studies were reported.

methodsWe searched PubMed to identify all observational studies published in 2018 that used RCD for assessing drug treatment effects. Teams of methods-trained collected data from eligible studies using pilot-tested, standardized forms that were developed and expanded from "The reporting of studies conducted using observational routinely collected health data statement for pharmacoepidemiology" (RECORD-PE) statement. We used descriptive analyses to examine how authors reported data source, study design, data analysis, and interpretation of findings.

resultsA total of 222 studies were included, of which 118 (53.2%) reported type of database used, 17 (7.7%) clearly reported database linkage, and 140 (63.1%) reported coverage of data source. Only 44 (19.8%) studies stated a predefined hypothesis, 127 (57.2%) reported study design, 140 (63.1%) reported statistical models used, 142 (77.6%) reported adjusted estimates, 33 (14.9%) mentioned sensitivity analyses, and 39 (17.6%) made a strong claim about treatment effect. Studies published in top 5 general medicine journals were more likely to report the name of data source (94.7% vs. 67.0%) and study design (100% vs. 53.2%) than those in other journals.

conclusionsThe under-reporting of key methodological features in abstracts of RCD studies was common, which would substantially compromise the indexing of this type of literature and prevent the effective use of study findings. Substantial efforts to improve the reporting of abstracts in these studies are highly warranted.

Indexed as

Research ReportRoutinely Collected Health DataCross-Sectional StudiesData CollectionHumansResearch DesignAbstract reportingCross-sectional studyDrug treatment effectRoutinely collected data

Identifiers

PMID34996370
PMCPMC8742367

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.