Avoiding the time consuming for downloading the pre-trained models

📚 Migration

Very great project! I can successfully run the code:

from transformers import AutoTokenizer, AutoModel

tokenizer = AutoTokenizer.from_pretrained("bert-base-chinese")
model_Bert = AutoModel.from_pretrained("bert-base-chinese")

But, every time I run my code, the downloading processing are repeated, which is time consuming. So I wonder how to load the pre-trained models from my local directory instead of downloading the pre-trained models everytime?

[zartdinov]

Hi! It should work (examples for Linux systems)

# Save model to directory:
model.save_pretrained("./my_model_directory/") 

# Load model from directory:
model = AutoModel.from_pretrained("./my_model_directory/")

####################### OR ###########################

# Cache model to directory:
model = AutoModel.from_pretrained("bert-base-chinese", cache_dir="./my_model_directory/")

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.