question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

API/ENH: allow to do pure maximum statistic permutation tests without clustering

See original GitHub issue

Maximum statistic tests, like implemented in mne.stats.permutation_t_test are popular choices in M/EEG http://onlinelibrary.wiley.com/doi/10.1111/j.1469-8986.2011.01273.x/full I feel we could easily make our clustering API perform such tests by skipping the clustering if connectivity=False. This would allow us to use the same API to perform to perform general max stat tests for 1 and multiple samples with arbitrary stat functions, beyond the 1 sample t-test in mne.stats.permutation_t_test.

cc @agramfort @larsoner @SherazKhan etc.

Issue Analytics

  • State:closed
  • Created 6 years ago
  • Comments:8 (8 by maintainers)

github_iconTop GitHub Comments

1reaction
larsonercommented, Feb 22, 2018

+1 for adding adding connectivity=False to mean “no connectivity” (None means “regular lattice connectivity” now) and deprecating mne.stats.permutation_t_test

0reactions
dengemanncommented, Feb 26, 2018

if it is, speed is very rarely a limiting factor.

For benchmarking I implemented a generalized version that takes any stat_fun. When running it with ttest_1samp_no_p the loss in performance is not game changing. Another issue that this implementation has is memory as all permutations are precomputed, which on larger data consumes most of the time. It can also be done with a generator. But I agree that we should recycle permutation_t_test.

I agree with the common elements in Eric’s and Alex’ suggestions. Some temporary compromise would be ok. The next stable API should emerge with this GSOC.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Cluster-based stats improvements - potential GSoC (and future)
I like the Fieldtrip's cluster-based API in general but not the design , ... API/ENH: allow to do pure maximum statistic permutation tests...
Read more >
Cluster-based permutation tests on event-related fields
The objective of this tutorial is to give an introduction to the statistical analysis of event-related EEG and MEG data (denoted as M/EEG...
Read more >
How to use Permutation Tests - Towards Data Science
Permutation tests are non-parametric tests that solely rely on the assumption of exchangeability. To get a p-value, we randomly sample (without ...
Read more >
Nonparametric permutation tests for functional neuroimaging
Simply construct the permutation distribution of the maximal suprathreshold cluster size. For the statistic image corresponding to each possible relabeling, ...
Read more >
BIDS, cluster-based permutation tests, and effect sizes
We provide a tutorial on how to use cluster- based permutation testing to analyze developmental EEG data. This versatile test statistic ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found