Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
Incorrect memory usage for nvidia driver higher than R510
See original GitHub issueWhen I update my nvidia driver to 515.76, gpustat always shows there are 308MB memory used even no process using gpus.
But nvidia-smi shows there are no memory being used, so I am very confused…
Here is my environment: ubuntu 18.04 gpustat 1.0.0 nvidia-driver 515.76 kernel 4.15.0-171-generic
And here are the outputs of nvidia-smi and gpustat:
Issue Analytics
- State:
- Created 10 months ago
- Comments:7 (5 by maintainers)
Top Results From Across the Web
[EXPECTED BEHAVIOR] nvidia-smi reports incorrect memory ...
GPU -z reports the correct usage, and the card will happily allocate memory until it reaches the respective maximum. This is a very...
Read more >huchi huchinlp - GitHub
Incorrect memory usage for nvidia driver higher than R510. When I update my nvidia driver to 515.76, gpustat always shows there are 308MB...
Read more >CUDA Version mismatch in Docker with WSL2 backend
Your WSL driver is 472.84 and this is too old to work with CUDA 11.6 (it ... ECC | | Fan Temp Perf...
Read more >GPU Process Memory counters report incorrect value
Some GPUs do not use dedicated GPU memory. ... the new Dedicated GPU memory value is larger by approximately 100MB (or more) than...
Read more >NVIDIA-SMI on Linux Reports False GPU Memory Usage
Hello everyone, I am using Linux NVIDIA-SMI drivers and am mining with several P106-90 each one being capable of 3GB of memory.
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
same problem.
307MB more than
nvidia-smii tried nvidia-ml-py==11.515.48 11.515.75
gpustat==1.0.0
environment is docker nvcr.io/nvidia/cuda:11.7.1-cudnn8-devel-ubuntu20.04
Fixed via https://github.com/wookayin/gpustat/pull/143#issuecomment-1334541103.