getting runtime error when trying to run on a gpu node
See original GitHub issuePlease run microk8s inspect
and attach the generated tarball to this issue.
Microk8s v.1.21
Error:
Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for “nvidia” is configured
Troubleshooting:
- followed installation process here
- tested deployment with
microk8s enable gpu
We appreciate your feedback. Thank you for using microk8s.
Issue Analytics
- State:
- Created 2 years ago
- Comments:5 (2 by maintainers)
Top Results From Across the Web
How to dig the nvidia-container-runtime error? #248 - GitHub
I want to run nvidia-container-runtime from gpu-operator. But CrashLoopBack is occured. When I check the kubectl logs shows following error.
Read more >CUDA peer resources error when running on more than 8 ...
When running examples on more than 8 K80s, we are getting errors from CUDA like: cuda runtime error (60) : peer mapping resources...
Read more >Runtime error 999 when trying to use cuda with pytorch
For me this error occurs when my Laptop went to sleep mode before. Restarting solved the problem. – nick. Dec 2, 2019 at...
Read more >CUDA error when loading my model - PyTorch Forums
I'm trying to load a model and run it on GPU nodes. The code snippet is: import torch from torch import nn class...
Read more >NodeODM:GPU exited with strange error code - ODM
I'm trying nodeodm:gpu with a small dataset of 50 images and it's failing with the following message in the console output: · [ERROR]...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
You’re welcome @inohmonton99, thanks for raising the issue. Yes, MicroK8s will detect whether or not you have drivers already installed and configure the NVIDIA operator accordingly.
everything’s working now. thanks for the quick solution @joedborg , also with
latest/edge
I didn’t need to install NVIDIA drivers only needed to enable gpu and it installed everything. Awesome!