question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

PyTorch XLA for TPU kernels

See original GitHub issue

I don’t know if this is the right repository for requesting changes to the TPU Kaggle Kernel VM. If not, please let me know which is the correct GitHub repository or Kaggle forum for this.

When we use PyTorch XLA in Kaggle Kernels, we always require the following installation code:

!curl https://raw.githubusercontent.com/pytorch/xla/master/contrib/scripts/env-setup.py -o pytorch-xla-env-setup.py
!python pytorch-xla-env-setup.py --version nightly --apt-packages libomp5 libopenblas-dev

Essentially, this code runs this program. It obtains the appropriate wheels, uninstalls torch and torchvision, and installs torch_xla and its corresponding versions of torch and torchvision. It also installs two Linux packages, libomp5 and libopenblas-dev.

Can the Linux packages and PyTorch XLA package be pre-installed in the TPU Kaggle Kernel? This process takes two minutes or so, and it’s slightly annoying to keep waiting for this during interactive mode. So it would be really helpful if it is pre-installed.

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Reactions:1
  • Comments:6 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
ifigotincommented, Jun 25, 2020

@jysohn23 may have more context on this, however, my understanding is that the releases are not GA yet, so may possibly break, and have instabilities. Additionally, the current installation process (via the script provided by the team) will also change. We are planning to revisit integrating everything into Kaggle image after the GA.

0reactions
tmabrahamcommented, Jun 25, 2020

@ifigotin My understanding though is that there is already a release with most of the major features (unless there is a plan to change a major part of the interface). I am not talking about the nightly version, but rather the v1.5 release from a couple months ago. However, I understand if PyTorch XLA team is not ready for it to be available as part of the Kaggle image, and I guess I will just have to wait…

Read more comments on GitHub >

github_iconTop Results From Across the Web

Cloud TPU PyTorch/XLA user guide
This section shows how to run Docker on TPU VM with PyTorch/XLA pre-installed. Note: At this time, running Docker on TPU VM is...
Read more >
Pytorch-XLA: Understanding TPU's and XLA | Kaggle
In this Notebook I share my experimentations with Pytorch-XLA and TPU's . ... You will be able to Decode and easily understand ALEX's...
Read more >
PyTorch on XLA Devices
PyTorch runs on XLA devices, like TPUs, with the torch_xla package. ... The kernels written here need to construct 'XLATensor' using the input...
Read more >
Training on a TPU in parallel using PyTorch XLA
Train your model now many times faster using all TPU cores at once! · Optimizer has to stepped with xm. · You have...
Read more >
pytorch/xla: Enabling PyTorch on Google TPU - GitHub
PyTorch /XLA is a Python package that uses the XLA deep learning compiler to connect the PyTorch deep learning framework and Cloud TPUs....
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found