Evidence map›Paper›PMID 35950321›Full record

ArticleAssessment2023

How Accurate and Consistent Are Score-Based Assessment Decisions? A Procedure Using the Linear Factor Model.

Oscar Gonzalez, A R Georgeson, William E Pelham

Abstract read
In one paragraph

Article in Assessment, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Oscar GonzalezThe University of North Carolina at Chapel Hill, USA.ORCID 0000-0001-7122-8799
A R GeorgesonArizona State University, Tempe, USA.
William E PelhamUniversity of California, San Diego, USA.

Funding

Family processes underlying adolescent substance use and conduct problems: disentangling correlation and causationK08DA055935 · NIDA · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI William Ellerbe Pelham III · 2022 to 2026
$959k
The impact of the COVID-19 pandemic on adolescent drinking in a longitudinal cohort spanning 21 U.S. citiesR21AA030197 · NIAAA · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI PELHAM III, WILLIAM ELLERBE · 2022 to 2023
$447k
Advancing measurement and scoring methods for testing mediation models of substance useF32DA053137 · NIDA · ARIZONA STATE UNIVERSITY-TEMPE CAMPUS · PI GEORGESON, ALEXIS RAE · 2022 to 2024
$210k
NIAAA NIH HHS R21 AA030197NIDA NIH HHS F32 DA053137NIDA NIH HHS K08 DA055935
6 · The paper itself

Abstract

When scales or tests are used to make decisions about individuals (e.g., to identify which adults should be assessed for psychiatric disorders), it is crucial that these decisions be accurate and consistent. However, it is not obvious how to assess accuracy and consistency when the scale was administered only once to a given sample and the true condition based on the latent variable is unknown. This article describes a method based on the linear factor model for evaluating the accuracy and consistency of scale-based decisions using data from a single administration of the scale. We illustrate the procedure and provide R code that investigators can use to apply the method in their own data. Finally, in a simulation study, we evaluate how the method performs when applied to discrete (vs. continuous) items, a practice that is common in published literature. The results suggest that the method is generally robust when applied to discrete items.

Indexed as

Clinical Decision-MakingLinear ModelsMental DisordersPsychiatric Status Rating ScalesAdultHumansMonte Carlo MethodProgramming LanguagesReference ValuesReproducibility of ResultsSensitivity and Specificityclassification accuracyclassification consistencylinear factor model

Identifiers

PMID35950321
PMCPMC10807789

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.