Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Calculating Backwards For SRU Results in CUDA error.

See original GitHub issue

I’m not sure how, but I’m seeing this error when I try to compute the backwards function. Don’t know if you’ve come across this during your debug?

Traceback (most recent call last):
  File "gan_language.py", line 341, in <module>
    G.backward(one)
  File "/usr/local/lib/python2.7/dist-packages/torch/autograd/variable.py", line 156, in backward
    torch.autograd.backward(self, gradient, retain_graph, create_graph, retain_variables)
  File "/usr/local/lib/python2.7/dist-packages/torch/autograd/__init__.py", line 98, in backward
    variables, grad_variables, retain_graph)
  File "/home/nick/wgan-gp/sru/cuda_functional.py", line 417, in backward
    stream=SRU_STREAM
  File "cupy/cuda/function.pyx", line 129, in cupy.cuda.function.Function.__call__ (cupy/cuda/function.cpp:4010)  File "cupy/cuda/function.pyx", line 111, in cupy.cuda.function._launch (cupy/cuda/function.cpp:3647)
  File "cupy/cuda/driver.pyx", line 127, in cupy.cuda.driver.launchKernel (cupy/cuda/driver.cpp:2541)
  File "cupy/cuda/driver.pyx", line 62, in cupy.cuda.driver.check_status (cupy/cuda/driver.cpp:1446)
cupy.cuda.driver.CUDADriverError: CUDA_ERROR_INVALID_HANDLE: invalid resource handle

Issue Analytics

State:
Created 6 years ago
Comments:7 (4 by maintainers)

Top GitHub Comments

1reaction

taolei87commented, Sep 12, 2017

@NickShahML btw, you can specify GPU using flag e.g. CUDA_VISIBLE_DEVICES=1, just in case you don’t know (probably not true 😃)

1reaction

NickShahMLcommented, Sep 12, 2017

@taolei87 the fix was just to use one gpu, that is…gpu 0. Thanks for the help!

Top Results From Across the Web

runtimeerror: cuda error: cublas_status_execution_failed when ...

I am building a Deep reinforcement learning agent using pytorch. Everything works fine until today where while training outputs error as stated above....

A Flexible Hybrid BCH Decoder for Modern NAND Flash ...

In this paper, we propose a pragmatic approach to decode BCH codes over the different finite fields using hardware circuits and GPUs in...

TRAINING RNNS AS FAST AS CNNS - OpenReview

The computation is then reduced to a simple feed-forward transformation (matrix multiplication), and loses the properties and quality of a convolution. The SRU...

thyroid.pdf - AIUM

This parameter was revised by the AIUM in collabo- ration with the ACR, SPR, and SRU according to the process described in the...

A Flexible BCH decoder for Flash Memory Systems using ...

In the case of an error, the key-equation solver and the error locator steps are executed. For t bit error correction on a...