Evidence map›Paper›PMID 38836248›Full record

ArticleJournal of clinical and translational science2024

Development and initial psychometric properties of the Research Complexity Index.

Allison A Norful, Bernadette Capili, Christine Kovner, Olga F Jarrín, Laura Viera, Scott McIntosh, Jacqueline Attia, Bridget Adams, Kitt Swartz, Ashley Brown and 1 more

Abstract read
In one paragraph

Article in Journal of clinical and translational science, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Canadian oncology nursing journal = Revue canadienne de nursing oncologique · 2026
    Article
  2. Scoping review of oncology clinical trials nursing: Roles, competencies, and evolving practice in cancer research.Canadian oncology nursing journal = Revue canadienne de nursing oncologique · 2026
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Allison A NorfulColumbia University School of Nursing, New York, NY, USA.ORCID https://orcid.org/0000-0002-6202-058X
Bernadette CapiliRockefeller University, New York, NY, USA.
Christine KovnerNew York University Rory Meyers College of Nursing, New York, NY, USA.
Olga F JarrínRutgers The State University of New Jersey, New Brunswick, NJ, USA.
Laura VieraUniversity of North Carolina, Chapel Hill, NC, USA.
Scott McIntoshUniversity of Rochester Medical Center-CLIC, Rochester, NY, USA.
Jacqueline AttiaUniversity of Rochester Medical Center-CLIC, Rochester, NY, USA.
Bridget AdamsOregon Health & Science University, Portland, OR, USA.
Kitt SwartzOregon Health & Science University, Portland, OR, USA.
Ashley BrownUniversity of North Carolina, Chapel Hill, NC, USA.
Margaret Barton-BurkeMemorial Sloan Kettering Cancer Center, New York, NY, USA.

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Hongbiao Carl Lekaye · 1985 to 2026
$347.4M
Oregon Clinical and Translational Research Institute - The National COVID Cohort Collaborative (N3C)UL1TR002369 · NCATS · OREGON HEALTH & SCIENCE UNIVERSITY · PI Cynthia D Morris, Christopher G. Slatore · 2017 to 2026
$78.4M
VISUAL INDICES OF NEUROTOXICITYP30ES001247 · NIEHS · UNIVERSITY OF ROCHESTER · PI Sally W Thurston · 1985 to 2026
$42.8M
North Carolina Translational and Clinical Sciences Institute (NC TraCS)UM1TR004406 · NCATS · UNIV OF NORTH CAROLINA CHAPEL HILL · PI NICHOLAS J SHAHEEN · 2023 to 2026
$37.5M
New Jersey Alliance for Clinical Translational Science: NJ ACTSUL1TR003017 · NCATS · RUTGERS BIOMEDICAL/HEALTH SCIENCES-RBHS · PI PANETTIERI, REYNOLD ALEXANDER · 2019 to 2023
$28.9M
NJ ACTS: A Platform for Translational Science in New JerseyUM1TR004789 · NCATS · RUTGERS BIOMEDICAL AND HEALTH SCIENCES · PI Reynold Alexander Panettieri · 2024 to 2026
$16.8M
NCATS NIH HHS UL1 TR002369NCATS NIH HHS UL1 TR003017NCATS NIH HHS UM1 TR004406NCATS NIH HHS UM1 TR004789NCI NIH HHS P30 CA008748NIEHS NIH HHS P30 ES001247
6 · The paper itself

Abstract

Objective: Research study complexity refers to variables that contribute to the difficulty of a clinical trial or study. This includes variables such as intervention type, design, sample, and data management. High complexity often requires more resources, advanced planning, and specialized expertise to execute studies effectively. However, there are limited instruments that scale study complexity across research designs. The purpose of this study was to develop and establish initial psychometric properties of an instrument that scales research study complexity. Methods: Technical and grammatical principles were followed to produce clear, concise items using language familiar to researchers. Items underwent face, content, and cognitive validity testing through quantitative surveys and qualitative interviews. Content validity indices were calculated, and iterative scale revision was performed. The instrument underwent pilot testing using 2 exemplar protocols, asking participants ( Results: The instrument (Research Complexity Index) demonstrated face, content, and cognitive validity. Item mean and standard deviation ranged from 1.0 to 2.75 (Protocol 1) and 1.31 to 2.86 (Protocol 2). Corrected item-total correlations ranged from .030 to .618. Eight elements appear to be under correlated to other elements. Cronbach's alpha was 0.586 (Protocol 1) and 0.764 (Protocol 2). Inter-rater reliability was fair (kappa = 0.338). Conclusion: Initial pilot testing demonstrates face, content, and cognitive validity, moderate internal consistency reliability and fair inter-rater reliability. Further refinement of the instrument may increase reliability thus providing a comprehensive method to assess study complexity and related resource quantification (e.g., staffing requirements).

Indexed as

Clinical researchinstrumentationpsychometricresearch designworkload

Identifiers

PMID38836248
PMCPMC11148820

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.