Evidence map›Paper›PMID 39506622›Full record

ArticleEpidemiology and psychiatric sciences2024

A guide for planning triangulation studies to investigate complex causal questions in behavioural and psychiatric research.

Jorien L Treur, Eva Lukas, Hannah M Sallis, Robyn E Wootton

Abstract read
In one paragraph

Article in Epidemiology and psychiatric sciences, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. BMJ mental health · 2026
    Article
  2. Article
  3. Review
  4. Review
  5. Editorial Perspective: Smoking, vaping and mental health - a perspective on potential causal mechanisms.Journal of child psychology and psychiatry, and allied disciplines · 2026
    Article
  6. Article
  7. Autistic traits and alcohol consumption through adolescence and young adulthood.medRxiv : the preprint server for health sciences · 2025
    Article
  8. Review
  9. Article
  10. Observational
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Jorien L TreurGenetic Epidemiology, Department of Psychiatry, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands.ORCID https://orcid.org/0000-0003-4370-3390
Eva LukasGenetic Epidemiology, Department of Psychiatry, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands.
Hannah M SallisCentre for Academic Mental Health, School of Social and Community Medicine, University of Bristol, Bristol, UK.
Robyn E WoottonLovisenberg Diaconal Hospital, Nic Waals Institute, Oslo, Norway.

Funding

European Research Council 101076686
6 · The paper itself

Abstract

aimsAt the basis of many important research questions is causality - does X causally impact Y? For behavioural and psychiatric traits, answering such questions can be particularly challenging, as they are highly complex and multifactorial. 'Triangulation' refers to prospectively choosing, conducting and integrating several methods to investigate a specific causal question. If different methods, with different sources of bias, all indicate a causal effect, the finding is much less likely to be spurious. While triangulation can be a powerful approach, its interpretation differs across (sub)fields and there are no formal guidelines. Here, we aim to provide clarity and guidance around the process of triangulation for behavioural and psychiatric epidemiology, so that results of existing triangulation studies can be better interpreted, and new triangulation studies better designed.

methodsWe first introduce the concept of triangulation and how it is applied in epidemiological investigations of behavioural and psychiatric traits. Next, we put forth a systematic step-by-step guide, that can be used to design a triangulation study (accompanied by a worked example). Finally, we provide important general recommendations for future studies.

resultsWhile the literature contains varying interpretations, triangulation generally refers to an investigation that assesses the robustness of a potential causal finding by explicitly combining different approaches. This may include multiple types of statistical methods, the same method applied in multiple samples, or multiple different measurements of the variable(s) of interest. In behavioural and psychiatric epidemiology, triangulation commonly includes prospective cohort studies, natural experiments and/or genetically informative designs (including the increasingly popular method of Mendelian randomization). The guide that we propose aids the planning and interpreting of triangulation by prompting crucial considerations. Broadly, its steps are as follows: determine your causal question, draw a directed acyclic graph, identify available resources and samples, identify suitable methodological approaches, further specify the causal question for each method, explicate the effects of potential biases and, pre-specify expected results. We illustrated the guide's use by considering the question: 'Does maternal tobacco smoking during pregnancy cause offspring depression?'.

conclusionsIn the current era of big data, and with increasing (public) availability of large-scale datasets, triangulation will become increasingly relevant in identifying robust risk factors for adverse mental health outcomes. Our hope is that this review and guide will provide clarity and direction, as well as stimulate more researchers to apply triangulation to causal questions around behavioural and psychiatric traits.

Indexed as

CausalityResearch DesignBehavioral ResearchHumansMental DisordersPsychiatryBehaviourbiascausalitypreventionpsychiatrytriangulation

Identifiers

PMID39506622
PMCPMC7616800

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.