Speed up scipy functions performance using multi_processing/multi_threading
See original GitHub issueI have an idea about speed up functions performance (cpu bound) using either multiprocessing or multi-threading.
According to the conversations i had with @rgommers , providing support for multiprocessing with scipy functions can be done. for example differential_evolution (using workers
keyword)
It would be nice if we can build a multiprocessor system that can generate parallelized instance of functions.
Thoughts?
Issue Analytics
- State:
- Created 4 years ago
- Comments:5 (5 by maintainers)
Top Results From Across the Web
Multiprocessing/Multithreading - does not improve speed
@user3371056 In Python, threads can't speed up CPU-bound operations, because the Global Interpreter Lock prevents more than one thread from ...
Read more >2.4. Optimizing code - Scipy Lecture Notes
Optimize the code by profiling simple use-cases to find the bottlenecks and speeding up these bottleneck, finding a better algorithm or implementation.
Read more >Multiprocessing/Multithreading in Python - HackMD
Multithreading - If the code you want to speed up is IO bound, e.g. read/write in local machine, request/response from the server. Using...
Read more >Using Multiprocessing to Make Python Code Faster
In this post, we discuss how Urban uses multiprocessing to speed up Python code. Common research programming languages use only one ...
Read more >How to Speed Up API Requests With Async Python - YouTube
... show you how to take a slow running script with many API calls and convert it to an async version that will...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
For something like
khatri_rao
there’s nothing to parallelize at the SciPy level, all it is is a few numpy calls.I’ll close this, since there’s no specific issue, we’ll put the general “we’d like performance improvements” on the roadmap.