Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

weird errors on colab

See original GitHub issue

can someone help e figure this out? since the updates things are acting really weird sometimes i can generate 1-2 images before the errors begin, other times it begins at once… and if i get the error i have to rerun every cell again. and this is really annoying, since i just bought the colab pro+ to use SD for a project. and now nothing is working…

sometimes it doesnt even help to rerun the cells. the only choice i have is to delete the SD folder and start from scratch again the errors in getting is this: Traceback (most recent call last): File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/modules/ui.py”, line 221, in f res = list(func(*args, **kwargs)) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/webui.py”, line 63, in f res = func(*args, **kwargs) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/modules/txt2img.py”, line 48, in txt2img processed = process_images(p) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/modules/processing.py”, line 359, in process_images res = process_images_inner(p) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/modules/processing.py”, line 452, in process_images_inner samples_ddim = p.sample(conditioning=c, unconditional_conditioning=uc, seeds=seeds, subseeds=subseeds, subseed_strength=p.subseed_strength) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/modules/processing.py”, line 600, in sample samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.create_dummy_mask(x)) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/modules/sd_samplers.py”, line 463, in sample samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args={ File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/modules/sd_samplers.py”, line 365, in launch_sampling return func() File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/modules/sd_samplers.py”, line 468, in <lambda> }, disable=False, callback=self.callback_state, **extra_params_kwargs)) File “/usr/local/lib/python3.7/dist-packages/torch/autograd/grad_mode.py”, line 27, in decorate_context return func(*args, **kwargs) File “/content/gdrive/MyDrive/sd/stable-diffusion/src/k-diffusion/k_diffusion/sampling.py”, line 173, in sample_dpm_2_ancestral denoised_2 = model(x_2, sigma_mid * s_in, **extra_args) File “/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py”, line 1130, in _call_impl return forward_call(*input, **kwargs) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/modules/sd_samplers.py”, line 298, in forward x_out[a:b] = self.inner_model(x_in[a:b], sigma_in[a:b], cond={“c_crossattn”: [tensor[a:b]], “c_concat”: [image_cond_in[a:b]]}) File “/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py”, line 1130, in _call_impl return forward_call(*input, **kwargs) File “/content/gdrive/MyDrive/sd/stable-diffusion/src/k-diffusion/k_diffusion/external.py”, line 112, in forward eps = self.get_eps(input * c_in, self.sigma_to_t(sigma), **kwargs) File “/content/gdrive/MyDrive/sd/stable-diffusion/src/k-diffusion/k_diffusion/external.py”, line 138, in get_eps return self.inner_model.apply_model(*args, **kwargs) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/ldm/models/diffusion/ddpm.py”, line 987, in apply_model x_recon = self.model(x_noisy, t, **cond) File “/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py”, line 1130, in _call_impl return forward_call(*input, **kwargs) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/ldm/models/diffusion/ddpm.py”, line 1410, in forward out = self.diffusion_model(x, t, context=cc) File “/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py”, line 1130, in _call_impl return forward_call(*input, **kwargs) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/ldm/modules/diffusionmodules/openaimodel.py”, line 732, in forward h = module(h, emb, context) File “/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py”, line 1130, in _call_impl return forward_call(*input, **kwargs) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/ldm/modules/diffusionmodules/openaimodel.py”, line 85, in forward x = layer(x, context) File “/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py”, line 1130, in _call_impl return forward_call(*input, **kwargs) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/ldm/modules/attention.py”, line 418, in forward x = block(x, context=context) File “/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py”, line 1130, in _call_impl return forward_call(*input, **kwargs) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/ldm/modules/attention.py”, line 254, in forward hidden_states = self.ff(self.norm3(hidden_states)) + hidden_states File “/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py”, line 1130, in _call_impl return forward_call(*input, **kwargs) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/ldm/modules/attention.py”, line 71, in forward return self.net(x) File “/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py”, line 1130, in _call_impl return forward_call(*input, **kwargs) File “/usr/local/lib/python3.7/dist-packages/torch/nn/modules/container.py”, line 139, in forward input = module(input) File “/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py”, line 1130, in _call_impl return forward_call(*input, **kwargs) File “/usr/local/lib/python3.7/dist-packages/torch/nn/modules/linear.py”, line 114, in forward return F.linear(input, self.weight, self.bias) RuntimeError: CUDA error: CUBLAS_STATUS_INTERNAL_ERROR when calling cublasGemmEx( handle, opa, opb, m, n, k, &falpha, a, CUDA_R_16F, lda, b, CUDA_R_16F, ldb, &fbeta, c, CUDA_R_16F, ldc, CUDA_R_32F, CUBLAS_GEMM_DFALT_TENSOR_OP)

Interrupted with signal 2 in <frame at 0x7f49da602e50, file ‘/content/gdrive/MyDrive/sd/stable-diffusion-webui/webui.py’, line 110, code wait_on_server> Traceback (most recent call last): File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/webui.py”, line 171, in <module> webui() File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/webui.py”, line 152, in webui wait_on_server(demo) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/webui.py”, line 110, in wait_on_server time.sleep(0.5) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/webui.py”, line 97, in sigint_handler print(f’Interrupted with signal {sig} in {frame}‘) File “/content/gdrive/MyDrive/sd/stable-diffusion-webui/webui.py”, line 97, in sigint_handler print(f’Interrupted with signal {sig} in {frame}’) RuntimeError: reentrant call inside <_io.BufferedWriter name=‘<stdout>’> Total progress: 3% 1/36 [00:11<06:26, 11.03s/it]