Inference API: Can't load tokenizer using from_pretrained, please update its configuration: No such file or directory (os error 2)

Environment info

• transformers version:
• Platform:
• Python version:
• PyTorch version (GPU?):
• Tensorflow version (GPU?):
• Using GPU in script?:
• Using distributed or parallel set-up in script?:

Who can help

@LysandreJik @patil-suraj

Information

I am trying to use the Inference API in the HuggingFace Hub with a version of GPT-2 I finetuned on a custom task.

To reproduce

When I try to use the api, the following error comes

Steps to reproduce the behavior: Here is the files I have in my private repo:

Expected behavior

I uploaded the tokenizer files to colab, and I was able to instantiate a tokenizer with the from_pretrained method, so I don’t know why the inference api throws an error.

[Narsil]

tokenizer_config.json is necessary for some additional information in the tokenizer. Original gpt2 repo might be different, but there’s some code for legacy models to make sure everything works smoothly for those.

The path within that file is indeed something to look into but it should work nonetheless.

[rouzki]

Hi,

Having the same issue, Steps followed :

• Trained the model (t5-base) using custom PyTorch (no Trainer).
• Loading model and tokenizer locally works fine using T5Tokenizer (not using AutoTokenizer ).
• Pushed the model to HuggingFace hub using model.push_to_hub() and tokenizer.push_to_hub()

Behavior :

• Loaded tokenizer from hub using AutoTokenizer doesn’t work.
• Loading using T5Tokenizer also from hub works.
• Looking at the files directory in the hub, only seeing tokenizer_config.json !
• Interface API gives the error : Can’t load tokenizer using from_pretrained, please update its configuration: No such file or directory (os error 2)