Evidence map›Paper›PMID 32380951›Full record

SynthesisBMC medical research methodology2020

Psychometric properties of measures of substance use: a systematic review and meta-analysis of reliability, validity and diagnostic test accuracy.

Glenn-Milo Santos, Steffanie A Strathdee, Nabila El-Bassel, Poonam Patel, Divya Subramanian, Danielle Horyniak, Ryan R Cook, Charlotte McCullagh, Phillip Marotta, Foram Choksi and 3 more

Open access · goldAbstract readMeta-AnalysisSystematic Review
In one paragraph

Synthesis in BMC medical research methodology, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 1 pooled it
0.7field-weighted citation impact, top 28% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 1 synthesis or guideline pooled it, 18 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Positive Childhood Experiences are Associated With Alcohol Use in Adolescent and Emerging Adult Females by Adverse Childhood Experiences Dimension.The Journal of adolescent health : official publication of the Society for Adolescent Medicine · 2024
    Article
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors at 8 institutions in 2 countries.

Glenn-Milo SantosDepartment of Community Health Systems, University of California San Francisco, 25 Van Ness Avenue, Suite 500, San Francisco, CA, 94102, USA. Glenn-Milo.Santos@ucsf.edu.
Steffanie A StrathdeeDivision of Global Public Health, University of California San Diego, San Diego, CA, USA.
Nabila El-BasselSchool of Social Work, Columbia University, New York, NY, USA.
Poonam PatelCenter for Public Health Research, San Francisco Department of Public Health, San Francisco, CA, USA.
Divya SubramanianCenter for Public Health Research, San Francisco Department of Public Health, San Francisco, CA, USA.
Danielle HoryniakDivision of Global Public Health, University of California San Diego, San Diego, CA, USA.
Ryan R CookDepartment of Family Medicine and Psychiatry and Biobehavioral Sciences, University of California Los Angeles, Los Angeles, CA, USA.
Charlotte McCullaghSchool of Social Work, Columbia University, New York, NY, USA.
Phillip MarottaSchool of Social Work, Columbia University, New York, NY, USA.
Foram ChoksiCenter for Public Health Research, San Francisco Department of Public Health, San Francisco, CA, USA.
Brian KangCenter for Public Health Research, San Francisco Department of Public Health, San Francisco, CA, USA.
Isabel AllenDepartment of Epidemiology and Biostatistics, University of California San Francisco, San Francisco, CA, USA.
Steven ShoptawDepartment of Family Medicine and Psychiatry and Biobehavioral Sciences, University of California Los Angeles, Los Angeles, CA, USA.
San Francisco Department of Public Health · USColumbia University · USBurnet Institute · AUNeurobehavioral Systems · USUnity Health System · USUniversity of California, Los Angeles · USUniversity of California, San Diego · USUniversity of California, San Francisco · US

Funding

LOC: HIV Prevention Trials NetworkUM1AI068619 · NIAID · FAMILY HEALTH INTERNATIONAL · PI Sinead Delany-Moretlwe, RAPHAEL J LANDOVITZ · 2011 to 2026
$779.5M
UCLA AIDS Prevention and Treatment Clinical Trials UnitUM1AI069424 · NIAID · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI Judith S. Currier, RAPHAEL J LANDOVITZ · 2012 to 2026
$51.8M
Substance Use and HIV Prevention Research in Minority Communities Training ProgramR25DA028567 · NIDA · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Julia Lechuga, Torsten Brian Neilands · 2009 to 2026
$5.4M
NIAID NIH HHS UM1 AI068619NIAID NIH HHS UM1 AI069424NIDA NIH HHS R25 DA028567
6 · The paper itself

Abstract

backgroundSynthesis of psychometric properties of substance use measures to identify patterns of use and substance use disorders remains limited. To address this gap, we sought to systematically evaluate the psychometric properties of measures to detect substance use and misuse.

methodsWe conducted a systematic review and meta-analysis of literature on measures of substance classes associated with HIV risk (heroin, methamphetamine, cocaine, ecstasy, alcohol) that were published in English before June 2016 that reported at least one of the following psychometric outcomes of interest: internal consistency (alpha), test-retest/inter-rater reliability (kappa), sensitivity, specificity, positive predictive value, and negative predictive value. We used meta-analytic techniques to generate pooled summary estimates for these outcomes using random effects and hierarchical logistic regression models.

resultsFindings across 387 paper revealed that overall, 65% of pooled estimates for alpha were in the range of fair-to-excellent; 44% of estimates for kappa were in the range of fair-to-excellent. In addition, 69, 97, 37 and 96% of pooled estimates for sensitivity, specificity, positive predictive value, and negative predictive value, respectively, were in the range of moderate-to-excellent.

conclusionWe conclude that many substance use measures had pooled summary estimates that were at the fair/moderate-to-excellent range across different psychometric outcomes. Most scales were conducted in English, within the United States, highlighting the need to test and validate these measures in more diverse settings. Additionally, the majority of studies had high risk of bias, indicating a need for more studies with higher methodological quality.

Indexed as

Diagnostic Tests, RoutineSubstance-Related DisordersHumansPsychometricsReproducibility of ResultsAlcoholDrugsMeta-analysisPsychometric propertiesSubstance use

Identifiers

PMID32380951
PMCPMC7203822
OpenAlexW3022796533

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.