question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Speed up scipy functions performance using multi_processing/multi_threading

See original GitHub issue

I have an idea about speed up functions performance (cpu bound) using either multiprocessing or multi-threading. According to the conversations i had with @rgommers , providing support for multiprocessing with scipy functions can be done. for example differential_evolution (using workers keyword) It would be nice if we can build a multiprocessor system that can generate parallelized instance of functions.

Thoughts?

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:5 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
rgommerscommented, Mar 18, 2020

For something like khatri_rao there’s nothing to parallelize at the SciPy level, all it is is a few numpy calls.

0reactions
rgommerscommented, May 8, 2020

I’ll close this, since there’s no specific issue, we’ll put the general “we’d like performance improvements” on the roadmap.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Multiprocessing/Multithreading - does not improve speed
@user3371056 In Python, threads can't speed up CPU-bound operations, because the Global Interpreter Lock prevents more than one thread from ...
Read more >
2.4. Optimizing code - Scipy Lecture Notes
Optimize the code by profiling simple use-cases to find the bottlenecks and speeding up these bottleneck, finding a better algorithm or implementation.
Read more >
Multiprocessing/Multithreading in Python - HackMD
Multithreading - If the code you want to speed up is IO bound, e.g. read/write in local machine, request/response from the server. Using...
Read more >
Using Multiprocessing to Make Python Code Faster
In this post, we discuss how Urban uses multiprocessing to speed up Python code. Common research programming languages use only one ...
Read more >
How to Speed Up API Requests With Async Python - YouTube
... show you how to take a slow running script with many API calls and convert it to an async version that will...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found