ONNX conversion of deberta_v2 models

System Info

transformers: 4.22.2 platform: Ubuntu 20.04.2 python: 3.8.10

Who can help?

DeBERTa-v2: @LysandreJik

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, …)
• My own task or dataset (give details below)

Reproduction

The following command fails: python -m transformers.onnx --model=microsoft/deberta-v3-small onnx/

The model can be microsoft/{mdeberta-v3-base, deberta-v3-small, deberta-v3-base, etc.}. The main problem lies in the symbolic(...) method of the class XSoftmax class, that is called while tracing the model. However, there are several other warnings while converting the model (Are they important?)

Expected behavior

Model saved as ONNX format.

[lewtun]

Hey @kobiche thanks for reporting this error, we also noticed this in #19255 when validating the deberta models with different batch size / seq len compared to the one used to trace the model.

We’ll aim to patch this ASAP

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.