Only using 65% of GPU memory
See original GitHub issueWhile running some benchmarks I noticed min-dalle was only using 65% of my 3070 Ti GPU’s memory:
Here’s the function I’m calling:
def run_dalle():
generate_image(
is_mega=True,
text='rich ducks playing poker',
seed=0,
grid_size=3,
top_k=256,
image_path='generated',
models_root='pretrained',
fp16=True,
)
After running it 50 times, each image takes 54.5 seconds on average to generate. It’s running baremetal on 32x E5-2630 v3 threads and 64 GB RAM.
Is there a way to make it use more of the GPU? or am I reading this wrong? Thanks!
Issue Analytics
- State:
- Created a year ago
- Comments:6
Top Results From Across the Web
Why Is My GPU Usage So Low? 11 Causes and Fixes
Why Is My GPU Usage So Low? 11 Causes and Fixes · 1. Your computer is using integrated graphics · 2. The GPU...
Read more >Only Getting Max 65% GPU Usage and Lowish FPS - Reddit
I am only getting about 115 to 170 fps and it fluctuates a lot. I am running an i5-7500 and a GTX 1060...
Read more >65% - 50% gpu usage - Graphics Cards - Linus Tech Tips
Hello, I built my first pc couple of days ago and im getting 65% to 50% gpu and cpu usage when gaming. I...
Read more >[SOLVED] - Why is my GPU not using 100%?
Hey, I have a question about my gpu/cpu usage while gaming! Laptop: Lenovo Y540 I7-9750h 6 cores. GTX 1660TI 6GB 16GB RAM
Read more >GPU Memory Usage shows "N/A" - CUDA Setup and Installation
When I type “nvidia-smi”, GPU Memory Usage shows “N… ... If you just want to know which processes currently use the GPU(s), nvidia-smi...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
I had been using my own utility script for batch generation here
I have it set to
is_mega=True
The default for the pip package
EDIT:
Checking back, it is the Mega Version. Will also try non-mega…
Non-mega went to about 9 seconds per image