Evidence map›Paper›PMID 33599711›Full record

ArticleClinical science (London, England : 1979)2021

How accurate are citations of frequently cited papers in biomedical literature?

Vedrana Pavlovic, Tracey Weissgerber, Dejana Stanisavljevic, Tatjana Pekmezovic, Ognjen Milicevic, Jelena Milin Lazovic, Andja Cirkovic, Marko Savic, Nina Rajovic, Pavle Piperac and 10 more

Abstract read
In one paragraph

Article in Clinical science (London, England : 1979), 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Detecting Reference Errors in Scientific Literature with Large Language Models.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2024
    Article
  6. Review
  7. Article
  8. Article
  9. Is the future of peer review automated?BMC research notes · 2022
    Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

20 authors.

Vedrana PavlovicInstitute for Medical Statistics and Informatics, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Tracey WeissgerberCharité - Universitätsmedizin Berlin, Berlin Institute of Health, QUEST Center, Berlin.
Dejana StanisavljevicInstitute for Medical Statistics and Informatics, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Tatjana PekmezovicInstitute of Epidemiology, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Ognjen MilicevicInstitute for Medical Statistics and Informatics, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Jelena Milin LazovicInstitute for Medical Statistics and Informatics, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Andja CirkovicInstitute for Medical Statistics and Informatics, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Marko SavicInstitute for Medical Statistics and Informatics, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Nina RajovicInstitute for Medical Statistics and Informatics, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Pavle PiperacDepartment of Humanities, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Nemanja DjuricInstitute for Medical Statistics and Informatics, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Petar MadzarevicInstitute for Medical Statistics and Informatics, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Ana DimitrijevicClinical Center of Serbia, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Simona RandjelovicInstitute for Medical Statistics and Informatics, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Emilija NestorovicClinical Center of Serbia, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Remi AkinyomboInstitute for Medical Statistics and Informatics, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Andrija PavlovicInstitute for Medical Statistics and Informatics, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.
Ranine GhamrawiDivision of Nephrology and Hypertension, Department of Internal Medicine, Mayo Clinic, Rochester, MN U.S.A.
Vesna GarovicDivision of Nephrology and Hypertension, Department of Internal Medicine, Mayo Clinic, Rochester, MN U.S.A.
Natasa MilicInstitute for Medical Statistics and Informatics, Faculty of Medicine, University of Belgrade, Belgrade, Serbia.

Funding

Hypertensive pregnancy disorders and future coronary artery diseaseR01HL136348 · NHLBI · MAYO CLINIC ROCHESTER · PI GAROVIC, VESNA D · 2018 to 2022
$2.6M
NHLBI NIH HHS R01 HL136348
6 · The paper itself

Abstract

Citations are an important, but often overlooked, part of every scientific paper. They allow the reader to trace the flow of evidence, serving as a gateway to relevant literature. Most scientists are aware of citations' errors, but few appreciate the prevalence of these problems. The purpose of the present study was to examine how often frequently cited papers in biomedical scientific literature are cited inaccurately. The study included an active participation of the first authors of included papers; to first-hand verify the citations accuracy. Findings from feasibility study, where we reviewed 1540 articles containing 2526 citations of 14 most cited articles in which the authors were affiliated with the Faculty of Medicine University of Belgrade, were further evaluated for external confirmation in an independent verification set of articles. Verification set included 4912 citations identified in 2995 articles that cited 13 most cited articles published by authors affiliated with the Mayo Clinic Division of Nephrology and Hypertension. A citation was defined as being accurate if the cited article supported or was in accordance with the statement by citing authors. At least one inaccurate citation was found in 11 and 15% of articles in the feasibility study and verification set, respectively, suggesting that inaccurate citations are common in biomedical literature. The most common problem was the citation of nonexistent findings (38.4%), followed by an incorrect interpretation of findings (15.4%). One-fifth of inaccurate citations were due to chains of inaccurate citations. Based on these findings, several actions to reduce citation inaccuracies have been proposed.

Indexed as

BibliometricsPeriodicals as TopicData AccuracyAccuracyBiomedical literatureCitationError

Identifiers

PMID33599711
PMCPMC8048031

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.