n_jobs greater than 1 causes segmentation fault
See original GitHub issueDescribe the bug
Setting n_jobs for sklearn.manifold.TSNE
to anything greater than 1 (including -1) causes a segmentation fault
Steps/Code to Reproduce
Example:
import numpy as np
from sklearn.manifold import TSNE
TSNE(n_components=2,n_jobs=1).fit_transform(np.zeros((100,512)) # Runs fine
TSNE(n_components=2,n_jobs=2).fit_transform(np.zeros((100,512)) # Segmentation fault
Expected Results
Would expect it to work with any amount of n_jobs
Actual Results
Segmentation fault
Versions
System: python: 3.7.3 (default, Mar 26 2019, 01:59:45) [GCC 5.4.0 20160609] executable: /home/<ME>/.virtualenvs/reid/bin/python3.7 machine: Linux-4.15.0-39-generic-x86_64-with-Ubuntu-16.04-xenial
Python dependencies:
pip: 20.0.1
setuptools: 41.0.1
sklearn: 0.22.1
numpy: 1.16.3
scipy: 1.2.1
Cython: 0.29.12
pandas: 0.25.1
matplotlib: 3.0.3
joblib: 0.13.2
Built with OpenMP: True
N.B. Could very well be related to #12922 but I’m not sure.
Issue Analytics
- State:
- Created 4 years ago
- Comments:10 (10 by maintainers)
Top Results From Across the Web
Identify what's causing segmentation faults (segfaults)
A segmentation fault (aka segfault) is a common condition that causes programs to crash; they are often associated with a file named core...
Read more >Segmentation fault when using more than 1 node for mpi job
When I run my code [which is an ocean physics/biogeochemistry model] on 1 node, I experience no issues. However, when I run on...
Read more >Common Causes of Segmentation Faults (Segfaults)
A segmentation fault (often called a segfault) can occur if a program you are running attempts to access an invalid memory location.
Read more >DataStage jobs fail with OshExecuter.sh Segmentation fault ...
A segmentation fault in OshExecuter.sh at line 25 means that the script was unable to launch the primary parallel job process, osh. This ......
Read more >What is a segmentation fault (segfault) error? - Ask
These issues are most commonly caused by programming errors, but can also be related to out-of-memory errors. If you encounter a segmentation ......
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
My bad. Updated.
@JakeCowton it would be great if you could try to reduce the problem further:
pairwise_distances
?joblib.Parallel
?