Evidence map›Paper›PMID 28383950›Full record

ArticlePsychological methods2018

Multilevel factorial designs with experiment-induced clustering.

Inbal Nahum-Shani, John J Dziak, Linda M Collins

2 registry-linked trialsAbstract read
In one paragraph

Article in Psychological methods, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 2 registered trials, which are not on this map. Cited by 14 papers.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT01814072 phase2 / phase3completednot on this map

Opt-IN: Optimization of Remotely Delivered Intensive Lifestyle Treatment for Obesity

TypeinterventionalSponsorNorthwestern UniversityRan2013 to 2017Enrolled562ConditionsWeight LossArms12 Telephone Coaching Sessions, 24 Telephone Coaching Sessions, Report to Primary Care Physician, Text Messages, Recommendations to use meal replacements
NCT06722781 narecruitingnot on this mapstarted 2025, after this paper: background citation

UpLift-X Trial 1: A Cluster Factorial Randomised Controlled Trial of Digitally-enabled Group Psychotherapy for Common Mental Disorders

TypeinterventionalSponsorRotherham Doncaster and South Humber NHS Foundation TrustRan2025 to 2026Enrolled660ConditionsCommon Mental Health Problems, Anxiety, Depression DisordersArmsUnified Protocol
3 · Its place in the literature

Who cites it

14 citing papers in PubMed.

  1. Trial
  2. Article
  3. Article
  4. Review
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Article
  14. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Inbal Nahum-ShaniInstitute for Social Research, University of Michigan.
John J DziakThe Methodology Center, Pennsylvania State University.ORCID 0000-0003-0762-5495
Linda M CollinsDepartment of Human Development & Family Studies, Pennsylvania State University.ORCID 0000-0003-4282-8722

Funding

THE REFINEMENT &APPLICATION OF MEDICAL DECISION MAKING IN PREVENTION SCIENCESP50DA010075 · NIDA · PENNSYLVANIA STATE UNIVERSITY-UNIV PARK · PI LANZA, STEPHANIE T · 1996 to 2014
$24.5M
Testing Relapse Recovery Intervention ComponentsP01CA180945 · NCI · UNIVERSITY OF WISCONSIN-MADISON · PI COOK, JESSICA MEGAN · 2014 to 2023
$23.0M
Pilot, Mentoring, and Professional Development CoreP50DA039838 · NIDA · PENNSYLVANIA STATE UNIVERSITY, THE · PI COLLINS, LINDA M, LANZA, STEPHANIE T · 2015 to 2019
$13.9M
Novel Methods for Intensive Longitudinal Data in SMART Studies of Drug Abuse and HIVR01DA039901 · NIDA · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI ALMIRALL, DANIEL, NAHUM-SHANI, INBAL BILLIE · 2015 to 2024
$5.4M
Opt-IN: Optimizing INtensive Lifestyle Intervention for Weight LossR01DK097364 · NIDDK · NORTHWESTERN UNIVERSITY AT CHICAGO · PI COLLINS, LINDA M, SPRING, BONNIE · 2012 to 2016
$3.0M
Engineering an Online STI Prevention ProgramR01AA022931 · NIAAA · PENNSYLVANIA STATE UNIVERSITY, THE · PI RULISON, KELLY LIN · 2015 to 2019
$3.0M
Data-Based Methods for Just-In-Time Adaptive Interventions in Alcohol UseR01AA023187 · NIAAA · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI MURPHY, SUSAN A · 2015 to 2019
$2.6M
NCI NIH HHS P01 CA180945NIAAA NIH HHS R01 AA022931NIAAA NIH HHS R01 AA023187NIDA NIH HHS P50 DA010075NIDA NIH HHS P50 DA039838NIDA NIH HHS R01 DA039901NIDDK NIH HHS R01 DK097364NIH HHS
6 · The paper itself

Abstract

Factorial experimental designs have many applications in the behavioral sciences. In the context of intervention development, factorial experiments play a critical role in building and optimizing high-quality, multicomponent behavioral interventions. One challenge in implementing factorial experiments in the behavioral sciences is that individuals are often clustered in social or administrative units and may be more similar to each other than to individuals in other clusters. This means that data are dependent within clusters. Power planning resources are available for factorial experiments in which the multilevel structure of the data is due to individuals' membership in groups that existed before experimentation. However, in many cases clusters are generated in the course of the study itself. Such experiment-induced clustering (EIC) requires different data analysis models and power planning resources from those available for multilevel experimental designs in which clusters exist prior to experimentation. Despite the common occurrence of both experimental designs with EIC and factorial designs, a bridge has yet to be built between EIC and factorial designs. Therefore, resources are limited or nonexistent for planning factorial experiments that involve EIC. This article seeks to bridge this gap by extending prior models for EIC, developed for single-factor experiments, to factorial experiments involving various types of EIC. We also offer power formulas to help investigators decide whether a particular experimental design involving EIC is feasible. We demonstrate that factorial experiments can be powerful and feasible even with EIC. We discuss design considerations and directions for future research. (PsycINFO Database Record

Indexed as

Data Interpretation, StatisticalFactor Analysis, StatisticalModels, StatisticalResearch DesignBehavioral SciencesHumansMultilevel Analysis

Identifiers

PMID28383950
PMCPMC5630520

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.