Evidence map›Paper›PMID 31660251›Full record

ArticleJournal of clinical and translational science2019

Measuring quality and outcomes of research collaborations: An integrative review.

Beth B Tigges, Doriane Miller, Katherine M Dudding, Joyce E Balls-Berry, Elaine A Borawski, Gaurav Dave, Nathaniel S Hafer, Kim S Kimminau, Rhonda G Kost, Kimberly Littlefield and 3 more

Abstract read
In one paragraph

Article in Journal of clinical and translational science, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
24citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

24 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Beth B TiggesUniversity of New Mexico, College of Nursing, Albuquerque, NM, USA.ORCID https://orcid.org/0000-0001-9821-8232
Doriane MillerDepartment of Internal Medicine, University of Chicago Hospitals, Chicago, IL, USA.
Katherine M DuddingDepartment of Family, Community and Health Systems, University of Arizona, College of Nursing, Tucson, AZ, USA.
Joyce E Balls-BerryDivision of Epidemiology, Mayo Clinic, Rochester, MN, USA.
Elaine A BorawskiDepartment of Population and Quantitative Health Sciences, Case Western Reserve University School of Medicine, Cleveland, OH, USA.
Gaurav DaveDepartment of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
Nathaniel S HaferCenter for Clinical and Translational Science, University of Massachusetts Medical School, Worcester, MA, USA.
Kim S KimminauUniversity of Kansas Medical Center, Family Medicine and Community Health, Kansas City, KS, USA.
Rhonda G KostThe Rockefeller University, Clinical Research Support Office, New York, NY, USA.
Kimberly LittlefieldUniversity of North Carolina-Greensboro, Office of Research and Engagement, Greensboro, NC, USA.
Jackilen ShannonOregon Health and Sciences University, OHSU-PSU School of Public Health, Portland, OR, USA.
Usha MenonUniversity of South Florida College of Nursing, Tampa, FL, USA.
Measures of Collaboration Workgroup of the Collaboration and Engagement Domain Task Force, National Center for Advancing Translational Sciences, National Institutes of Health

Funding

Mayo Clinic Center for Clinical and Translational Science (CCaTS UL1 Supplement - Dr. Timothy Curry)UL1TR002377 · NCATS · MAYO CLINIC ROCHESTER · PI VESNA D GAROVIC · 2017 to 2026
$78.4M
Oregon Clinical and Translational Research Institute - The National COVID Cohort Collaborative (N3C)UL1TR002369 · NCATS · OREGON HEALTH & SCIENCE UNIVERSITY · PI Cynthia D Morris, Christopher G. Slatore · 2017 to 2026
$78.4M
The Institute for Translational MedicineUL1TR002389 · NCATS · UNIVERSITY OF CHICAGO · PI Joshua J Jacobs, DAVID O MELTZER · 2017 to 2026
$71.6M
Clinical and Translational Science Collaborative of ClevelandUL1TR000439 · NCATS · CASE WESTERN RESERVE UNIVERSITY · PI KONSTAN, MICHAEL W. · 2012 to 2016
$50.0M
Re-Entry Supplement: Investigation of Oral Microbial Enzymes for the Detection and Treatment of Periodontal DiseaseUL1TR002489 · NCATS · UNIV OF NORTH CAROLINA CHAPEL HILL · PI BUSE, JOHN BERNARD, SHAHEEN, NICHOLAS J · 2018 to 2022
$48.6M
RADx-UP: Improving the Response of Local Urban and Rural Communities to Disparities in Covid-19 TestingUL1TR002366 · NCATS · UNIVERSITY OF KANSAS MEDICAL CENTER · PI Mario Castro, JAMES STEVEN LEEDER · 2017 to 2026
$44.3M
National Dissemination of I-Corps@NCATS: Accelerating Translation through CommercializationUL1TR003096 · NCATS · UNIVERSITY OF ALABAMA AT BIRMINGHAM · PI GUTIERREZ, ORLANDO M, KIMBERLY, ROBERT P. · 2019 to 2023
$43.6M
Developing, Demonstrating, and Disseminating Innovative Programs to Achieve Translational SuccessUL1TR001866 · NCATS · ROCKEFELLER UNIVERSITY · PI COLLER, BARRY, KRUEGER, JAMES G · 2016 to 2025
$40.6M
University of Massachusetts Center for Clinical Science and Translational SupplementUL1TR001453 · NCATS · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI LUZURIAGA, KATHERINE F · 2015 to 2024
$39.0M
UNM HSC Clinical and Translational Science CenterUL1TR001449 · NCATS · UNIVERSITY OF NEW MEXICO HEALTH SCIS CTR · PI CAMPEN, MATTHEW J, PANDHI, NANCY · 2015 to 2024
$36.9M
Clinical and Translational Science Collaborative of ClevelandUL1TR002548 · NCATS · CASE WESTERN RESERVE UNIVERSITY · PI MCCOMSEY, GRACE A · 2018 to 2022
$35.5M
UAB Center for Clinical and Translational Science (CCTS)UL1TR001417 · NCATS · UNIVERSITY OF ALABAMA AT BIRMINGHAM · PI KIMBERLY, ROBERT P. · 2015 to 2018
$31.4M
NCATS NIH HHS U24 TR002260NCATS NIH HHS UL1 TR000128NCATS NIH HHS UL1 TR000430NCATS NIH HHS UL1 TR000439NCATS NIH HHS UL1 TR001417NCATS NIH HHS UL1 TR001449NCATS NIH HHS UL1 TR001453NCATS NIH HHS UL1 TR001866NCATS NIH HHS UL1 TR002366NCATS NIH HHS UL1 TR002369NCATS NIH HHS UL1 TR002377NCATS NIH HHS UL1 TR002389NCATS NIH HHS UL1 TR002489NCATS NIH HHS UL1 TR002548NCATS NIH HHS UL1 TR003096NCRR NIH HHS M01 RR000585NIGMS NIH HHS P20 GM130423
6 · The paper itself

Abstract

introductionAlthough the science of team science is no longer a new field, the measurement of team science and its standardization remain in relatively early stages of development. To describe the current state of team science assessment, we conducted an integrative review of measures of research collaboration quality and outcomes.

methodsCollaboration measures were identified using both a literature review based on specific keywords and an environmental scan. Raters abstracted details about the measures using a standard tool. Measures related to collaborations with clinical care, education, and program delivery were excluded from this review.

resultsWe identified 44 measures of research collaboration quality, which included 35 measures with reliability and some form of statistical validity reported. Most scales focused on group dynamics. We identified 89 measures of research collaboration outcomes; 16 had reliability and 15 had a validity statistic. Outcome measures often only included simple counts of products; publications rarely defined how counts were delimited, obtained, or assessed for reliability. Most measures were tested in only one venue.

conclusionsAlthough models of collaboration have been developed, in general, strong, reliable, and valid measurements of such collaborations have not been conducted or accepted into practice. This limitation makes it difficult to compare the characteristics and impacts of research teams across studies or to identify the most important areas for intervention. To advance the science of team science, we provide recommendations regarding the development and psychometric testing of measures of collaboration quality and outcomes that can be replicated and broadly applied across studies.

Indexed as

instrument developmentmeasuresoutcome measurepsychometricsresearch collaborationresearch evaluationresearch process measurescientific collaborationTeam scienceteamwork

Identifiers

PMID31660251
PMCPMC6813516

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.