API/ENH: allow to do pure maximum statistic permutation tests without clustering
See original GitHub issueMaximum statistic tests, like implemented in mne.stats.permutation_t_test
are popular choices in M/EEG http://onlinelibrary.wiley.com/doi/10.1111/j.1469-8986.2011.01273.x/full
I feel we could easily make our clustering API perform such tests by skipping the clustering if connectivity=False
. This would allow us to use the same API to perform to perform general max stat tests for 1 and multiple samples with arbitrary stat functions, beyond the 1 sample t-test in mne.stats.permutation_t_test
.
cc @agramfort @larsoner @SherazKhan etc.
Issue Analytics
- State:
- Created 6 years ago
- Comments:8 (8 by maintainers)
Top Results From Across the Web
Cluster-based stats improvements - potential GSoC (and future)
I like the Fieldtrip's cluster-based API in general but not the design , ... API/ENH: allow to do pure maximum statistic permutation tests...
Read more >Cluster-based permutation tests on event-related fields
The objective of this tutorial is to give an introduction to the statistical analysis of event-related EEG and MEG data (denoted as M/EEG...
Read more >How to use Permutation Tests - Towards Data Science
Permutation tests are non-parametric tests that solely rely on the assumption of exchangeability. To get a p-value, we randomly sample (without ...
Read more >Nonparametric permutation tests for functional neuroimaging
Simply construct the permutation distribution of the maximal suprathreshold cluster size. For the statistic image corresponding to each possible relabeling, ...
Read more >BIDS, cluster-based permutation tests, and effect sizes
We provide a tutorial on how to use cluster- based permutation testing to analyze developmental EEG data. This versatile test statistic ...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
+1 for adding adding
connectivity=False
to mean “no connectivity” (None means “regular lattice connectivity” now) and deprecatingmne.stats.permutation_t_test
For benchmarking I implemented a generalized version that takes any stat_fun. When running it with
ttest_1samp_no_p
the loss in performance is not game changing. Another issue that this implementation has is memory as all permutations are precomputed, which on larger data consumes most of the time. It can also be done with a generator. But I agree that we should recyclepermutation_t_test
.I agree with the common elements in Eric’s and Alex’ suggestions. Some temporary compromise would be ok. The next stable API should emerge with this GSOC.