Evidence map›Paper›PMID 35502762›Full record

ArticleJournal of orthopaedic research : official publication of the Orthopaedic Research Society2023

Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics.

Jason P Halloran, Neda Abdollahi Nohouji, Mhd A Hafez, Thor F Besier, Snehal K Chokhandre, Shady Elmasry, Donald R Hume, Carl W Imhauser, Nynke B Rooks, Marco T Y Schneider and 4 more

Abstract read
In one paragraph

Article in Journal of orthopaedic research : official publication of the Orthopaedic Research Society, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed.

  1. Article
  2. Article
  3. Reproducibility in modeling and simulation of the knee: Academic, industry, and regulatory perspectives.Journal of orthopaedic research : official publication of the Orthopaedic Research Society · 2023
    Review
  4. Article
  5. Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics.Journal of orthopaedic research : official publication of the Orthopaedic Research Society · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Jason P HalloranInstitute for Shock Physics, Applied Sciences Laboratory, Washington State University, Spokane, Washington, USA.ORCID 0000-0001-5866-6583
Neda Abdollahi NohoujiCenter for Human Machine Systems, Cleveland State University, Cleveland, Ohio, USA.
Mhd A HafezCenter for Human Machine Systems, Cleveland State University, Cleveland, Ohio, USA.
Thor F BesierAuckland Bioengineering Institute, University of Auckland, Auckland, New Zealand.ORCID 0000-0003-0818-7554
Snehal K ChokhandreDepartment of Biomedical Engineering, Lerner Research Institute, Cleveland Clinic, Cleveland, Ohio, USA.
Shady ElmasryDepartment of Biomechanics, Hospital for Special Surgery, New York, New York, USA.ORCID 0000-0003-0193-7711
Donald R HumeDepartment of Mechanical and Materials Engineering, University of Denver, Denver, Colorado, USA.
Carl W ImhauserDepartment of Biomechanics, Hospital for Special Surgery, New York, New York, USA.
Nynke B RooksAuckland Bioengineering Institute, University of Auckland, Auckland, New Zealand.
Marco T Y SchneiderAuckland Bioengineering Institute, University of Auckland, Auckland, New Zealand.ORCID 0000-0002-4918-1389
Ariel SchwartzDepartment of Biomedical Engineering, Lerner Research Institute, Cleveland Clinic, Cleveland, Ohio, USA.
Kevin B ShelburneDepartment of Mechanical and Materials Engineering, University of Denver, Denver, Colorado, USA.
William ZaylorCenter for Human Machine Systems, Cleveland State University, Cleveland, Ohio, USA.
Ahmet ErdemirDepartment of Biomedical Engineering, Lerner Research Institute, Cleveland Clinic, Cleveland, Ohio, USA.

Funding

Reproducibility in simulation-based prediction of natural knee mechanicsR01EB024573 · NIBIB · CLEVELAND CLINIC LERNER COM-CWRU · PI AHMET ERDEMIR, Jason Halloran · 2017 to 2026
$5.0M
NIBIB NIH HHS R01 EB024573NIBIB NIH HHS R01EB024573
6 · The paper itself

Abstract

Reproducible research serves as a pillar of the scientific method and is a foundation for scientific advancement. However, estimates for irreproducibility of preclinical science range from 75% to 90%. The importance of reproducible science has not been assessed in the context of mechanics-based modeling of human joints such as the knee, despite this being an area that has seen dramatic growth. Framed in the context of five experienced teams currently documenting knee modeling procedures, the aim of this study was to evaluate reporting and the perceived potential for reproducibility across studies the teams viewed as important contributions to the literature. A cohort of studies was selected by polling, which resulted in an assessment of nine studies as opposed to a broader analysis across the literature. Using a published checklist for reporting of modeling features, the cohort was evaluated for both "reporting" and their potential to be "reproduced," which was delineated into six major modeling categories and three subcategories. Logistic regression analysis revealed that for individual modeling categories, the proportion of "reported" occurrences ranged from 0.31, 95% confidence interval (CI) [0.23, 0.41] to 0.77, 95% CI: [0.68, 0.86]. The proportion of whether a category was perceived as "reproducible" ranged from 0.22, 95% CI: [0.15, 0.31] to 0.44, 95% CI: [0.35, 0.55]. The relatively low ratios highlight an opportunity to improve reporting and reproducibility of knee modeling studies. Ongoing efforts, including our findings, contribute to a dialogue that facilitates adoption of practices that provide both credibility and translation possibilities.

Indexed as

KneeKnee JointBiomechanical PhenomenaHumansReproducibility of Resultsbiomechanicsfinite element analysisknee modelreproducibilityrigid-body analysis

Identifiers

PMID35502762
PMCPMC9630164

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.