Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
AssertionError: Model should be on CPU before parallelization. It is more memory-efficient.
See original GitHub issueHello, first of all congratulations for this amazing project. It’s simple, efficient and versatile. Very useful.
In some cases, it happens that one has several GPUs, but not enough RAM to parallelize the model.
When loading the model on GPU, and then parallelizing, I’m getting the below error:
AssertionError: Model should be on CPU before parallelization. It is more memory-efficient.
It doesn’t stop the script, but it seems that the parallelization fails.
My question is: is it possible to load the initial model on GPU instead of CPU (even if it’s not memory-efficient) or not at all?
Thanks!
Issue Analytics
- State:
- Created 2 years ago
- Comments:29 (16 by maintainers)
Top Results From Across the Web
Top Related Medium Post
Top Related StackOverflow Question
Troubleshoot Live Code
Top Related Reddit Thread
Top Related Hackernoon Post
Top Related Tweet
Top Related Dev.to Post
Top Related Hashnode Post
Thanks a lot @hyunwoongko . I will try the above and close this issue. I think my request goes beyond the scope of parallelformers. Thanks again!
It works great! Thanks for the quick addition! 🥇
Thanks again for the great work, that’s very useful.