Evidence map›Paper›PMID 34801856›Full record

ArticleDevelopmental cognitive neuroscience2021

Enhancing reproducibility in developmental EEG research: BIDS, cluster-based permutation tests, and effect sizes.

Marlene Meyer, Didi Lamers, Ezgi Kayhan, Sabine Hunnius, Robert Oostenveld

Open access · goldAbstract read
In one paragraph

Article in Developmental cognitive neuroscience, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 45 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
45citing papers in PubMed, 2 pooled it
7.3field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

45 citing papers in PubMed, 2 syntheses or guidelines pooled it, 93 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Sleep loss disrupts the neural signature of successful learning.Cerebral cortex (New York, N.Y. : 1991) · 2023
    Trial
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Noninvasive Biomarkers for Assessing the Excitatory/Inhibitory Imbalance in Children with Epilepsy.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2025
    Article
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 4 institutions in 3 countries.

Marlene MeyerDonders Institute for Brain, Cognition and Behavior, Radboud University, Nijmegen, NL, USA; Department of Psychology, University of Chicago, Chicago, IL, USA.
Didi LamersRadboud University Library, Radboud University, Nijmegen, NL, USA.
Ezgi KayhanDepartment of Developmental Psychology, University of Potsdam, Germany; Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
Sabine HunniusDonders Institute for Brain, Cognition and Behavior, Radboud University, Nijmegen, NL, USA.
Robert OostenveldDonders Institute for Brain, Cognition and Behavior, Radboud University, Nijmegen, NL, USA; NatMEG, Karolinska Institutet, Stockholm, SE, USA.
Radboud University Nijmegen · NLAllen Institute for Brain Science · USNTL Institute for Applied Behavioral Science · USUniversity of Potsdam · DE

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Developmental research using electroencephalography (EEG) offers valuable insights in brain processes early in life, but at the same time, applying this sensitive technique to young children who are often non-compliant and have short attention spans comes with practical limitations. It is thus of particular importance to optimally use the limited resources to advance our understanding of development through reproducible and replicable research practices. Here, we describe methodological approaches that help maximize the reproducibility of developmental EEG research. We discuss how to transform EEG data into the standardized Brain Imaging Data Structure (BIDS) which organizes data according to the FAIR data sharing principles. We provide a tutorial on how to use cluster-based permutation testing to analyze developmental EEG data. This versatile test statistic solves the multiple comparison problem omnipresent in EEG analysis and thereby substantially decreases the risk of reporting false discoveries. Finally, we describe how to quantify effect sizes, in particular of cluster-based permutation results. Reporting effect sizes conveys a finding's impact and robustness which in turn informs future research. To demonstrate these methodological approaches to data organization, analysis and report, we use a publicly accessible infant EEG dataset and provide a complete copy of the analysis code.

Indexed as

BrainElectroencephalographyChildChild, PreschoolHumansReproducibility of ResultsBIDScluster-based permutation testEEGeffect sizereproducibility

Identifiers

PMID34801856
PMCPMC8607163
OpenAlexW3213730518

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.