question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

n_jobs greater than 1 causes segmentation fault

See original GitHub issue

Describe the bug

Setting n_jobs for sklearn.manifold.TSNE to anything greater than 1 (including -1) causes a segmentation fault

Steps/Code to Reproduce

Example:

import numpy as np
from sklearn.manifold import TSNE
TSNE(n_components=2,n_jobs=1).fit_transform(np.zeros((100,512)) # Runs fine
TSNE(n_components=2,n_jobs=2).fit_transform(np.zeros((100,512)) # Segmentation fault

Expected Results

Would expect it to work with any amount of n_jobs

Actual Results

Segmentation fault

Versions

System: python: 3.7.3 (default, Mar 26 2019, 01:59:45) [GCC 5.4.0 20160609] executable: /home/<ME>/.virtualenvs/reid/bin/python3.7 machine: Linux-4.15.0-39-generic-x86_64-with-Ubuntu-16.04-xenial

Python dependencies:
       pip: 20.0.1
setuptools: 41.0.1
   sklearn: 0.22.1
     numpy: 1.16.3
     scipy: 1.2.1
    Cython: 0.29.12
    pandas: 0.25.1
matplotlib: 3.0.3
    joblib: 0.13.2

Built with OpenMP: True

N.B. Could very well be related to #12922 but I’m not sure.

Issue Analytics

  • State:open
  • Created 4 years ago
  • Comments:10 (10 by maintainers)

github_iconTop GitHub Comments

1reaction
JakeCowtoncommented, Jan 23, 2020

My bad. Updated.

0reactions
lestevecommented, Jan 29, 2020

@JakeCowton it would be great if you could try to reduce the problem further:

  • can you get the segmentation fault with pairwise_distances?
  • can you get the segmentation fault with only joblib.Parallel?
Read more comments on GitHub >

github_iconTop Results From Across the Web

Identify what's causing segmentation faults (segfaults)
A segmentation fault (aka segfault) is a common condition that causes programs to crash; they are often associated with a file named core...
Read more >
Segmentation fault when using more than 1 node for mpi job
When I run my code [which is an ocean physics/biogeochemistry model] on 1 node, I experience no issues. However, when I run on...
Read more >
Common Causes of Segmentation Faults (Segfaults)
A segmentation fault (often called a segfault) can occur if a program you are running attempts to access an invalid memory location.
Read more >
DataStage jobs fail with OshExecuter.sh Segmentation fault ...
A segmentation fault in OshExecuter.sh at line 25 means that the script was unable to launch the primary parallel job process, osh. This ......
Read more >
What is a segmentation fault (segfault) error? - Ask
These issues are most commonly caused by programming errors, but can also be related to out-of-memory errors. If you encounter a segmentation ......
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found