question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Any chance of upgrading from CUDA 11.0 to 11.1? (installing PyG with pip takes >1 hour)

See original GitHub issue

This is mostly related to Pytorch Geometric. From what i understand, issue #675 is unresolved due to issues with GPU tests. Fair enough, so I tried to use the following command on Kaggle Notebooks:

!pip install torch-scatter torch-sparse torch-cluster torch-spline-conv torch-geometric -f https://data.pyg.org/whl/torch-1.9.0+cu110.html

Unfortunately, this takes over 1 hour to install the packages, mostly building the wheel files for torch-sparse, torch-cluster, torch-spline-conv (some of which are required when importing torch_geometric). I believe that this is something related to the CUDA 11.0 version of these packages, given that I had a similar problem locally on my machine. On the other hand, if you run the following on Google Colab (currently with CUDA 11.1) or my own machine with CUDA 11.1:

!pip install torch-scatter torch-sparse torch-cluster torch-spline-conv torch-geometric -f https://data.pyg.org/whl/torch-1.9.0+cu111.html

, it takes only a few seconds.

Installing the CPU-only version of PyG does work in Kaggle Notebooks, but it’s inefficient to the point that waiting 1 hour at the start may still better in the long run.

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:7 (2 by maintainers)

github_iconTop GitHub Comments

1reaction
rosbocommented, Oct 4, 2022

It actually entails a lot given the large number of packages installed on our image.

@djherbis is hard at work trying to complete this upgrade. You can follow his progress on this PR: https://github.com/Kaggle/docker-python/pull/1182

1reaction
jaimergpcommented, Oct 4, 2022

The release notes for Google Deep Learning containers even state:

February 28, 2022 M90 Release

  • CUDA has been upgraded from 11.3.0 to 11.3.1 to address some NCCL issues.
  • GPU TensorFlow containers are available and have a significantly smaller size.
  • TensorFlow 2.7 containers are re-released.

So it has been available for a while, it looks like?

Read more comments on GitHub >

github_iconTop Results From Across the Web

Any chance of upgrading from CUDA 11.0 to 11.1? (installing ...
, it takes only a few seconds. Installing the CPU-only version of PyG does work in Kaggle Notebooks, but it's inefficient to the...
Read more >
The speed of pytorch with cudatoolkit 11.0 is slower than ...
When I update the pytorch to 1.7, the cudatoolkit is updated automaticlly to 11.0, and I find the speed of the same code...
Read more >
CUDA Compatibility :: NVIDIA Data Center GPU Driver ...
With minor version compatibility, upgrading to CUDA 11.1 is now possible on older drivers from within the same major release family such as ......
Read more >
How To Install CUDA 10 (together with 9.2) on Ubuntu 18.04 ...
This is an upgrade from the 9.x series and has support for the new Turing GPU architecture. This CUDA version has full support...
Read more >
PyTorch and torch_scatter were compiled with different CUDA ...
pip install torch-scatter==2.0.8 -f https://data.pyg.org/whl/torch-1.8.1+cu102.html. It looks like the latest torch-scatter version in ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found