Evidence map›Paper›PMID 34586077›Full record

ArticleJournal of medical Internet research2021

Scholarly Productivity Evaluation of KL2 Scholars Using Bibliometrics and Federal Follow-on Funding: Cross-Institution Study.

Kelli Qua, Fei Yu, Tanha Patel, Gaurav Dave, Katherine Cornelius, Clara M Pelfrey

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Kelli Qua *Clinical and Translational Science Collaborative, School of Medicine, Case Western Reserve University, Cleveland, OH, United States.ORCID 0000-0001-9901-9307
Fei Yu *Health Sciences Library, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States.ORCID 0000-0003-1079-1590
Tanha Patel *North Carolina Translational and Clinical Sciences Institute, School of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States.ORCID 0000-0002-4432-1469
Gaurav Dave *North Carolina Translational and Clinical Sciences Institute, School of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States.ORCID 0000-0003-0825-1595
Katherine Cornelius *Center for Clinical and Translational Science, Mayo Clinic, Rochester, MN, United States.ORCID 0000-0002-4517-697X
Clara M Pelfrey *Clinical and Translational Science Collaborative, School of Medicine, Case Western Reserve University, Cleveland, OH, United States.ORCID 0000-0002-6108-7555

Funding

Re-Entry Supplement: Investigation of Oral Microbial Enzymes for the Detection and Treatment of Periodontal DiseaseUL1TR002489 · NCATS · UNIV OF NORTH CAROLINA CHAPEL HILL · PI BUSE, JOHN BERNARD, SHAHEEN, NICHOLAS J · 2018 to 2022
$48.6M
Clinical and Translational Science Collaborative of ClevelandUL1TR002548 · NCATS · CASE WESTERN RESERVE UNIVERSITY · PI MCCOMSEY, GRACE A · 2018 to 2022
$35.5M
Institutional Career Development CoreKL2TR002379 · NCATS · MAYO CLINIC ROCHESTER · PI NILUFER ERTEKIN-TANER · 2017 to 2026
$14.9M
NCATS NIH HHS KL2 TR002379NCATS NIH HHS UL1 TR002489NCATS NIH HHS UL1 TR002548
6 · The paper itself

Abstract

backgroundEvaluating outcomes of the clinical and translational research (CTR) training of a Clinical and Translational Science Award (CTSA) hub (eg, the KL2 program) requires the selection of reliable, accessible, and standardized measures. As measures of scholarly success usually focus on publication output and extramural funding, CTSA hubs have started to use bibliometrics to evaluate the impact of their supported scholarly activities. However, the evaluation of KL2 programs across CTSAs is limited, and the use of bibliometrics and follow-on funding is minimal.

objectiveThis study seeks to evaluate scholarly productivity, impact, and collaboration using bibliometrics and federal follow-on funding of KL2 scholars from 3 CTSA hubs and to define and assess CTR training success indicators.

methodsThe sample included KL2 scholars from 3 CTSA institutions (A-C). Bibliometric data for each scholar in the sample were collected from both SciVal and iCite, including scholarly productivity, citation impact, and research collaboration. Three federal follow-on funding measures (at the 5-year, 8-year, and overall time points) were collected internally and confirmed by examining a federal funding database. Both descriptive and inferential statistical analyses were computed using SPSS to assess the bibliometric and federal follow-on funding results.

resultsA total of 143 KL2 scholars were included in the sample with relatively equal groups across the 3 CTSA institutions. The included KL2 scholars produced more publications and citation counts per year on average at the 8-year time point (3.75 publications and 26.44 citation counts) than the 5-year time point (3.4 publications vs 26.16 citation counts). Overall, the KL2 publications from all 3 institutions were cited twice as much as others in their fields based on the relative citation ratio. KL2 scholars published work with researchers from other US institutions over 2 times (5-year time point) or 3.5 times (8-year time point) more than others in their research fields. Within 5 years and 8 years postmatriculation, 44.1% (63/143) and 51.7% (74/143) of KL2 scholars achieved federal funding, respectively. The KL2-scholars of Institution C had a significantly higher citation rate per publication than the other institutions (P<.001). Institution A had a significantly lower rate of nationally field-weighted collaboration than did the other institutions (P<.001). Institution B scholars were more likely to have received federal funding than scholars at Institution A or C (P<.001).

conclusionsMulti-institutional data showed a high level of scholarly productivity, impact, collaboration, and federal follow-on funding achieved by KL2 scholars. This study provides insights on the use of bibliometric and federal follow-on funding data to evaluate CTR training success across institutions. CTSA KL2 programs and other CTR career training programs can benefit from these findings in terms of understanding metrics of career success and using that knowledge to develop highly targeted strategies to support early-stage career development of CTR investigators.

Indexed as

Awards and PrizesBibliometricsEfficiencyHumansResearch PersonnelTranslational Research, Biomedicalbibliometricscareer developmentClinical and Translational Science AwardKL2translational research

Identifiers

PMID34586077
PMCPMC8515229

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.