Evidence map›Paper›PMID 33278182›Full record

ArticleJournal of the American Academy of Orthopaedic Surgeons. Global research & reviews2020

Altmetrics Attention Scores for Randomized Controlled Trials in Total Joint Arthroplasty Are Reflective of High Scientific Quality: An Altmetrics-Based Methodological Quality and Bias Analysis.

Kyle N Kunze, Michelle Richardson, David N Bernstein, Ajay Premkumar, Nicolas S Piuzzi, Alexander S McLawhorn

Abstract read
In one paragraph

Article in Journal of the American Academy of Orthopaedic Surgeons. Global research & reviews, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Review
  13. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Kyle N KunzeFrom the Department of Orthopaedic Surgery, Hospital for Special Surgery, New York (Dr. Kunze, Dr. Premkumar, Dr. McLawhorn); University of Rochester School of Medicine, Rochester, NY (Ms. Richardson); the Department of Orthopaedic Surgery, Massachusetts General Hospital, Boston, MA (Dr. Bernstein); and the Department of Orthopaedic Surgery, Cleveland Clinic Foundation, Cleveland, OH (Dr. Piuzzi).ORCID 0000-0002-0363-3482
Michelle RichardsonORCID 0000-0002-6029-0949
David N BernsteinORCID 0000-0002-1784-3288
Nicolas S Piuzzi
Alexander S McLawhornORCID 0000-0001-7841-5095

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

introductionThe Altmetric Attention Score (AAS) has been associated with citation rates across medical and surgical disciplines. However, factors that drive high AAS remain poorly understood and there remains multiple pitfalls to correlating these metrics alone with the quality of a study. The purpose of the current study was to determine the relationship between methodologic and study biases and the AAS in randomized controlled trials (RCTs) published in total joint arthroplasty journals.

methodsAll RCTs from 2016 published in The Journal of Arthroplasty, The Bone and Joint Journal, The Journal of Bone and Joint Surgery, Clinical Orthopedics and Related Research, The Journal of Knee Surgery, Hip International, and Acta Orthopaedica were extracted. Methodologic bias was graded with the JADAD scale, whereas study bias was graded with the Cochrane risk of bias tool for RCTs. Publication characteristics, social media attention (Facebook, Twitter, and Mendeley), AAS, citation rates, and bias were analyzed.

resultsA total of 42 articles were identified. The mean (±SD) citations and AAS per RCT was 17.8 ± 16.5 (range, 0 to 78) and 8.0 ± 15.4 (range, 0 to 64), respectively. The mean JADAD score was 2.6 ± 0.94. No statistically significant differences were observed in the JADAD score or total number of study biases when compared across the seven journals (P = 0.57 and P = 0.27). Higher JADAD scores were significantly associated with higher AAS scores (β = 6.7, P = 0.006) but not citation rate (P = 0.16). The mean number of study biases was 2.0 ± 0.93 (range, 0 to 4). A greater total number of study biases was significantly with higher AAS scores (β = -8.0, P < 0.001) but not citation rate (P = 0.10). The AAS was a significant and positive predictor of citation rate (β = 0.43, P = 0.019).

conclusionHigh methodologic quality and limited study bias markedly contribute to the AAS of RCTs in the total joint arthroplasty literature. The AAS may be used as a proxy measure of scientific quality for RCTs, although readers should still critically appraise these articles before making changes to clinical practice.

Indexed as

BibliometricsJournal Impact FactorArthroplastyBiasHumansRandomized Controlled Trials as Topic

Identifiers

PMID33278182
PMCPMC7714052

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.