question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Training does not use the Nvidia GPU, is it normal?

See original GitHub issue

When running ns-train nerfacto --data data/nerfstudio/poster, only the CPU of my laptop is getting some load. According to the task manager, the load of my Nvidia GPU is 0%. As a result, the training is quite slow, and I’m actually surprised that it works at all, considering CUDA was supposed to be required. Am I missing something? What info can I provide to help figure this one out?

OS : Windows 10 GPU : Nvidia RTX 3050 laptop Cuda : version returned by nvcc cuda_11.8.r11.8/compiler.31833905_0

Installation was done in a conda env as per the doc. Nerfstudio, installed nerfstudio==0.1.10 with pip

Issue Analytics

  • State:closed
  • Created 10 months ago
  • Comments:6 (1 by maintainers)

github_iconTop GitHub Comments

1reaction
mpizenbergcommented, Dec 5, 2022

@Jordan-Pierce it seems like you are right. It is an issue with windows task manager reporting. I just tried with nvidia-smi during the training, and the GPU is at 70% load, and not 0%.

image

0reactions
Disa-Kizondacommented, Dec 5, 2022

vram

Read more comments on GitHub >

github_iconTop Results From Across the Web

Training process is slow, GPU is not fully utilized
During the training, the time of each iteration can be quite different, and CPU cost too much time, GPU is poor utilized. I...
Read more >
Keras does not use my Nvidia GPU when training a neural ...
My GPU is not used by Keras/TensorFlow. To try to make my GPU working with tensorflow, I tried to install tensorflow-gpu (I am...
Read more >
[D] Why is GPU utilization so bad when training neural ...
I was talking to a friend about GPU training of neural networks and I wanted to say something along the lines of: "GPUs...
Read more >
How to fix low GPU usage on NVIDIA dedicated video card ...
Do you experience low GPU usage and slower performance on NVIDIA dedicated video cards. ... Your browser can't play this video.
Read more >
Monitor and Improve GPU Usage for Training Deep Learning ...
Measure your GPU usage consistently over your entire training runs. You can't improve GPU usage without measuring it. It's not hard to take...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found