Accelerator not recognizing TPU in Google Colab and Kaggle Kernels

I installed and imported accelerate in both Kaggle Kernels and Google Colab with TPU turned on but it doesn’t seem to detect the TPU and instead detects CPU when running the following code:

$ pip install -q accelerate

import accelerate
acc = accelerate.Accelerator()
device = acc.device
print(device)

The above snippet just outputs cpu when ran on both aforementioned platforms with TPU enabled.

Is there something that I am doing wrong?

PyTorch version: 1.7.0 Python version: 3.7.9

[sgugger]

This is fixed by #44, there is now a notebook_launcher that helps you run your training function in a colab or Kaggle notebook. Will add some examples soon!

[romanoss]

this is a kaggle notebook from the current shopee comp - easiest probably: join the comp and upload shopee-pytorch-eca-nfnet-l0-image-training.zip

I think the only thing you have to change is RETRAIN_MODEL=‘’ and switch USE_TPU_AND_ACCELERATE

a small bug: in train_fn() change data[k] = v.to(Config.DEVICE) to data[k] = v #in case of USE_TPU_AND_ACCELERATE=True