Evidence map›Paper›PMID 35464674›Full record

ArticleMethods in ecology and evolution2021

Common datastream permutations of animal social network data are not appropriate for hypothesis testing using regression models.

Michael N Weiss, Daniel W Franks, Lauren J N Brent, Samuel Ellis, Matthew J Silk, Darren P Croft

Abstract read
In one paragraph

Article in Methods in ecology and evolution, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 31 papers.

0numbers the graph read from it
0cells of the map it votes in
31citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

31 citing papers in PubMed.

  1. Article
  2. Article
  3. Population age structure shapes selection on social behaviour in a long-lived insect.Philosophical transactions of the Royal Society of London. Series B, Biological sciences · 2024
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Indirect genetic effects for social network structure inPhilosophical transactions of the Royal Society of London. Series B, Biological sciences · 2023
    Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. A guide to choosing and implementing reference models for social network analysis.Biological reviews of the Cambridge Philosophical Society · 2021
    Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Michael N WeissCentre for Research in Animal Behaviour, College of Life and Environmental Sciences, University of Exeter, Exeter, U.K. EX4 4QG.ORCID 0000-0002-7422-0538
Daniel W Franks *Department of Biology and Department of Computer Science, The University of York, York, U.K. YO10 5DD.ORCID 0000-0002-4832-7470
Lauren J N BrentCentre for Research in Animal Behaviour, College of Life and Environmental Sciences, University of Exeter, Exeter, U.K. EX4 4QG.
Samuel EllisCentre for Research in Animal Behaviour, College of Life and Environmental Sciences, University of Exeter, Exeter, U.K. EX4 4QG.
Matthew J SilkCentre for Ecology and Conservation, University of Exeter in Cornwall, Penryn, U.K. TR10 9FE.
Darren P Croft *Centre for Research in Animal Behaviour, College of Life and Environmental Sciences, University of Exeter, Exeter, U.K. EX4 4QG.

Funding

Social modifiers of the pace of aging across multiple domains and tissuesR01AG060931 · NIA · UNIVERSITY OF WASHINGTON · PI BRENT, LAUREN JOHANNA NICOLE, HIGHAM, JAMES P · 2019 to 2023
$3.6M
Neurogenomics of Vulnerability and Resilience to Mental Health Syndromes in Response to Extreme Life EventsR01MH118203 · NIMH · UNIVERSITY OF PENNSYLVANIA · PI PLATT, MICHAEL L · 2019 to 2023
$1.9M
NIA NIH HHS R01 AG060931NIMH NIH HHS R01 MH118203
6 · The paper itself

Abstract

1. Social network methods have become a key tool for describing, modelling, and testing hypotheses about the social structures of animals. However, due to the non-independence of network data and the presence of confounds, specialized statistical techniques are often needed to test hypotheses in these networks. Datastream permutations, originally developed to test the null hypothesis of random social structure, have become a popular tool for testing a wide array of null hypotheses in animal social networks. In particular, they have been used to test whether exogenous factors are related to network structure by interfacing these permutations with regression models. 2. Here, we show that these datastream permutations typically do not represent the null hypothesis of interest to researchers interfacing animal social network analysis with regression modelling, and use simulations to demonstrate the potential pitfalls of using this methodology. 3. Our simulations show that, if used to indicate whether a relationship exists between network structure and a covariate, datastream permutations can result in extremely high type I error rates, in some cases approaching 50%. In the same set of simulations, traditional node-label permutations produced appropriate type I error rates (~ 5%). 4. Our analysis shows that datastream permutations do not represent the appropriate null hypothesis for these analyses. We suggest that potential alternatives to this procedure may be found in regarding the problems of non-independence of network data and unreliability of observations separately. If biases introduced during data collection can be corrected, either prior to model fitting or within the model itself, node-label permutations then serve as a useful test for interfacing animal social network analysis with regression modelling.

Indexed as

group livingnull hypothesis significance testingnull modelpermutation testrandomisationsregressionsocial networks

Identifiers

PMID35464674
PMCPMC9033095

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.