Methodology & Meta-science

Shuffling observations in bootstrapping and permutation tests

Resamping approaches (bootstrapping and permutation tests) are commonly used but with little understanding of how the shuffling procedure should relate to the study design. I will talk about some of the basic rules of reshuffling as they apply to typical datasets in psychology and neuroscience.