Evidence map›Paper›PMID 29550526›Full record

ArticleNeuropsychologia2018

The impact of sample size on the reproducibility of voxel-based lesion-deficit mappings.

Diego L Lorca-Puls, Andrea Gajardo-Vidal, Jitrachote White, Mohamed L Seghier, Alexander P Leff, David W Green, Jenny T Crinion, Philipp Ludersdorfer, Thomas M H Hope, Howard Bowman and 1 more

Abstract read
In one paragraph

Article in Neuropsychologia, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 41 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
41citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

41 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Trial
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Transient Attention Gates Access Consciousness: Coupling N2pc and P3 Latencies Using Dynamic Time Warping.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2024
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Diego L Lorca-PulsWellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London WC1N 3BG, United Kingdom; Department of Speech, Language and Hearing Sciences, Faculty of Medicine, Universidad de Concepcion, PO Box 160-C, Concepcion, Chile. Electronic address: d.puls@ucl.ac.uk.
Andrea Gajardo-VidalWellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London WC1N 3BG, United Kingdom; Department of Speech, Language and Hearing Sciences, Faculty of Health Sciences, Universidad del Desarrollo, 4070001 Concepcion, Chile.
Jitrachote WhiteWellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London WC1N 3BG, United Kingdom.
Mohamed L SeghierWellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London WC1N 3BG, United Kingdom; Cognitive Neuroimaging Unit, Emirates College for Advanced Education, PO Box 126662, Abu Dhabi, United Arab Emirates.
Alexander P LeffInstitute of Cognitive Neuroscience, Division of Psychology and Language Sciences, University College London, London WC1N 3AR, United Kingdom; Department of Brain Repair and Rehabilitation, Institute of Neurology, University College London, London WC1N 3BG, United Kingdom.
David W GreenDepartment of Experimental Psychology, Division of Psychology and Language Sciences, University College London, London WC1H 0AP, United Kingdom.
Jenny T CrinionInstitute of Cognitive Neuroscience, Division of Psychology and Language Sciences, University College London, London WC1N 3AR, United Kingdom.
Philipp LudersdorferWellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London WC1N 3BG, United Kingdom.
Thomas M H HopeWellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London WC1N 3BG, United Kingdom.
Howard BowmanCentre for Cognitive Neuroscience and Cognitive Systems and the School of Computing, University of Kent, Canterbury CT2 7NF, United Kingdom; School of Psychology, University of Birmingham, Birmingham B15 2TT, United Kingdom.
Cathy J PriceWellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London WC1N 3BG, United Kingdom.

Funding

Department of Health II-LB-0813-20004Medical Research Council MR/M023672/1Wellcome Trust 205103/Z/16/Z
6 · The paper itself

Abstract

This study investigated how sample size affects the reproducibility of findings from univariate voxel-based lesion-deficit analyses (e.g., voxel-based lesion-symptom mapping and voxel-based morphometry). Our effect of interest was the strength of the mapping between brain damage and speech articulation difficulties, as measured in terms of the proportion of variance explained. First, we identified a region of interest by searching on a voxel-by-voxel basis for brain areas where greater lesion load was associated with poorer speech articulation using a large sample of 360 right-handed English-speaking stroke survivors. We then randomly drew thousands of bootstrap samples from this data set that included either 30, 60, 90, 120, 180, or 360 patients. For each resample, we recorded effect size estimates and p values after conducting exactly the same lesion-deficit analysis within the previously identified region of interest and holding all procedures constant. The results show (1) how often small effect sizes in a heterogeneous population fail to be detected; (2) how effect size and its statistical significance varies with sample size; (3) how low-powered studies (due to small sample sizes) can greatly over-estimate as well as under-estimate effect sizes; and (4) how large sample sizes (N ≥ 90) can yield highly significant p values even when effect sizes are so small that they become trivial in practical terms. The implications of these findings for interpreting the results from univariate voxel-based lesion-deficit analyses are discussed.

Indexed as

Brain MappingSample SizeAdolescentAdultAgedAged, 80 and overBrainFemaleHumansImage Processing, Computer-AssistedMagnetic Resonance ImagingMaleMiddle AgedRecognition, PsychologyRegression AnalysisReproducibility of ResultsDeficitLesionLesion-symptomReproducibilitySpeech productionStrokeVoxel-based

Identifiers

PMID29550526
PMCPMC6018568

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.