question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Only using 65% of GPU memory

See original GitHub issue

While running some benchmarks I noticed min-dalle was only using 65% of my 3070 Ti GPU’s memory:

image

Here’s the function I’m calling:

def run_dalle():
    generate_image(
        is_mega=True,
        text='rich ducks playing poker',
        seed=0,
        grid_size=3,
        top_k=256,
        image_path='generated',
        models_root='pretrained',
        fp16=True,
    )

After running it 50 times, each image takes 54.5 seconds on average to generate. It’s running baremetal on 32x E5-2630 v3 threads and 64 GB RAM.

Is there a way to make it use more of the GPU? or am I reading this wrong? Thanks!

Issue Analytics

  • State:open
  • Created a year ago
  • Comments:6

github_iconTop GitHub Comments

1reaction
78Alphacommented, Aug 2, 2022

I had been using my own utility script for batch generation here

I have it set to is_mega=True

1reaction
78Alphacommented, Jul 31, 2022

@78Alpha are you using the Mega model?

The default for the pip package

EDIT:

Checking back, it is the Mega Version. Will also try non-mega…

Non-mega went to about 9 seconds per image

Read more comments on GitHub >

github_iconTop Results From Across the Web

Why Is My GPU Usage So Low? 11 Causes and Fixes
Why Is My GPU Usage So Low? 11 Causes and Fixes · 1. Your computer is using integrated graphics · 2. The GPU...
Read more >
Only Getting Max 65% GPU Usage and Lowish FPS - Reddit
I am only getting about 115 to 170 fps and it fluctuates a lot. I am running an i5-7500 and a GTX 1060...
Read more >
65% - 50% gpu usage - Graphics Cards - Linus Tech Tips
Hello, I built my first pc couple of days ago and im getting 65% to 50% gpu and cpu usage when gaming. I...
Read more >
[SOLVED] - Why is my GPU not using 100%?
Hey, I have a question about my gpu/cpu usage while gaming! Laptop: Lenovo Y540 I7-9750h 6 cores. GTX 1660TI 6GB 16GB RAM
Read more >
GPU Memory Usage shows "N/A" - CUDA Setup and Installation
When I type “nvidia-smi”, GPU Memory Usage shows “N… ... If you just want to know which processes currently use the GPU(s), nvidia-smi...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found