Evidence map›Paper›PMID 39657180›Full record

ArticleJournal of medical Internet research2024

Ecological Momentary Assessment of Mental Health Problems Among University Students: Data Quality Evaluation Study.

Ana Portillo-Van Diest, Philippe Mortier, Laura Ballester, Franco Amigo, Paula Carrasco, Raquel Falcó, Margalida Gili, Glenn Kiekens, Francisco H Machancoses, Jose A Piqueras and 5 more

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Trial
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Observational
  7. Review
  8. Review
  9. Article
  10. Article
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Ana Portillo-Van DiestHospital del Mar Research Institute, Barcelona, Spain.ORCID 0000-0001-7199-8339
Philippe MortierHospital del Mar Research Institute, Barcelona, Spain.ORCID 0000-0003-2113-6241
Laura BallesterHospital del Mar Research Institute, Barcelona, Spain.ORCID 0000-0002-4892-7003
Franco AmigoHospital del Mar Research Institute, Barcelona, Spain.ORCID 0000-0002-3602-5168
Paula CarrascoCentro de Investigación Biomédica en Red (CIBER) de Epidemiología y Salud Pública, Instituto de Salud Carlos III, Madrid, Spain.ORCID 0000-0002-7170-4318
Raquel FalcóDepartment of Education Sciences, University of La Rioja, Logroño, Spain.ORCID 0000-0003-1426-5934
Margalida GiliInstituto Universitario de Investigación en Ciencias de la Salud-Instituto de Investigación Sanitaria Illes Balears (IUNICS-IDISBA), University of Balearic Islands, Palma de Mallorca, Spain.ORCID 0000-0002-0535-6773
Glenn KiekensCenter for Contextual Psychiatry, KU Leuven, Leuven, Belgium.ORCID 0000-0001-8747-3385
Francisco H MachancosesDepartment of Medicine, Science Health Faculty, Universitat Jaume I, Castelló de la Plana, Spain.ORCID 0000-0003-0280-5972
Jose A PiquerasDepartment of Health Psychology, Miguel Hernandez University of Elche, Elche, Spain.ORCID 0000-0002-3604-5441
Marisa RebagliatoCentro de Investigación Biomédica en Red (CIBER) de Epidemiología y Salud Pública, Instituto de Salud Carlos III, Madrid, Spain.ORCID 0000-0001-5825-0190
Miquel RocaInstituto Universitario de Investigación en Ciencias de la Salud-Instituto de Investigación Sanitaria Illes Balears (IUNICS-IDISBA), University of Balearic Islands, Palma de Mallorca, Spain.ORCID 0000-0001-7301-8373
Tíscar Rodríguez-JiménezDepartment of Psychology and Sociology, University of Zaragoza, Teruel, Spain.ORCID 0000-0001-9396-253X
Jordi AlonsoHospital del Mar Research Institute, Barcelona, Spain.ORCID 0000-0001-8627-9636
Gemma VilagutHospital del Mar Research Institute, Barcelona, Spain.ORCID 0000-0002-3714-226X

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe use of ecological momentary assessment (EMA) designs has been on the rise in mental health epidemiology. However, there is a lack of knowledge of the determinants of participation in and compliance with EMA studies, reliability of measures, and underreporting of methodological details and data quality indicators.

objectiveThis study aims to evaluate the quality of EMA data in a large sample of university students by estimating participation rate and mean compliance, identifying predictors of individual-level participation and compliance, evaluating between- and within-person reliability of measures of negative and positive affect, and identifying potential careless responding.

methodsA total of 1259 university students were invited to participate in a 15-day EMA study on mental health problems. Logistic and Poisson regressions were used to investigate the associations between sociodemographic factors, lifetime adverse experiences, stressful events in the previous 12 months, and mental disorder screens and EMA participation and compliance. Multilevel reliability and intraclass correlation coefficients were obtained for positive and negative affect measures. Careless responders were identified based on low compliance or individual reliability coefficients.

resultsOf those invited, 62.1% (782/1259) participated in the EMA study, with a mean compliance of 76.9% (SD 27.7%). Participation was higher among female individuals (odds ratio [OR] 1.41, 95% CI 1.06-1.87) and lower among those aged ≥30 years (OR 0.20, 95% CI 0.08-0.43 vs those aged 18-21 years) and those who had experienced the death of a friend or family member in the previous 12 months (OR 0.73, 95% CI 0.57-0.94) or had a suicide attempt in the previous 12 months (OR 0.26, 95% CI 0.10-0.64). Compliance was particularly low among those exposed to sexual abuse before the age of 18 years (exponential of β=0.87) or to sexual assault or rape in the previous year (exponential of β=0.80) and among those with 12-month positive alcohol use disorder screens (exponential of β=0.89). Between-person reliability of negative and positive affect was strong (R

conclusionsData quality assessments should be carried out in EMA studies in a standardized manner to provide robust conclusions to advance the field. Future EMA research should implement strategies to mitigate nonresponse bias as well as conduct sensitivity analyses to assess possible exclusion of careless responders.

Indexed as

Ecological Momentary AssessmentMental DisordersStudentsAdolescentAdultData AccuracyFemaleHumansMaleMental HealthReproducibility of ResultsUniversitiesYoung Adultcomplianceecological momentary assessmentexperience sampling methodmental healthmobile phoneparticipationreliabilitysensitivity analysisuniversity students

Identifiers

PMID39657180
PMCPMC11668991

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.