Flash DeepSpeedPlugin error

🐛 Bug

Hi, I’m completely new Flash, I’m having this error when trying to use DeepSpeedPlugin plugin on the Flash trainer. The code is

To Reproduce

import torch

import flash
from flash.audio import SpeechRecognition, SpeechRecognitionData
from flash.core.data.utils import download_data

# 1. Create the DataModule
download_data("https://pl-flash-data.s3.amazonaws.com/timit_data.zip", "./data")

datamodule = SpeechRecognitionData.from_json(
    "file",
    "text",
    train_file="data/timit/train.json",
    test_file="data/timit/test.json",
    batch_size=4,
)

# 2. Build the task
model = SpeechRecognition(backbone="facebook/wav2vec2-base-960h")

# 3. Create the trainer and finetune the model
trainer = flash.Trainer(max_epochs=1, gpus=torch.cuda.device_count(),plugins='deepspeed')
trainer.finetune(model, datamodule=datamodule, strategy="no_freeze")

# 4. Predict on audio files!
datamodule = SpeechRecognitionData.from_files(predict_files=["data/timit/example.wav"], batch_size=4)
predictions = trainer.predict(model, datamodule=datamodule)
print(predictions)

# 5. Save the model!
trainer.save_checkpoint("speech_recognition_model.pt")

I’m getting this

I thing there is an issue with named_params somewhere

[krshrimali]

Hi, @ar90n - I just wanted to thank you for your continuous efforts on this issue! Apologies for not being able to respond on time.

Just to acknowledge that we are aware of this, I’ll get back to you in a day or two. 😃 I appreciate the patience 🚀 and your efforts! ❤️

[ar90n]

Hi, after I looked into this issue, I found the cause of it. It doesn’t depend on lightning-flash. It occurs with only pytorch-lightning. And there is some issue like this in pytorch-ligntning Github project page. Therefore I added some comments on them and create a new issue about integration with pytorch-lightning and DeepSpeed. They are the followings.

• https://github.com/PyTorchLightning/pytorch-lightning/issues/13085
• https://github.com/PyTorchLightning/pytorch-lightning/issues/9833
• https://github.com/PyTorchLightning/pytorch-lightning/issues/12130

I think that if the above issue is solved, this issue will be solved automatically. I continue to try to solve them.