Help: cannot load pretrain models from .pytorch_pretrained_bert folder

I need to run the package on a machine without internet. Copied over the “.pytorch_pretrained_bert” folder from one machine to another. Installed anaconda3 and tried to run tokenizer = TransfoXLTokenizer.from_pretrained('transfo-xl-wt103'). Got this error: Model name 'transfo-xl-wt103' was not found in model name list (transfo-xl-wt103). We assumed 'transfo-xl-wt103' was a path or url but couldn't find files https://s3.amazonaws.com/models.huggingface.co/bert/transfo-xl-wt103-vocab.bin at this path or url. Do I need to copy anything else to the second machine to make it load from the cache folder? Ubuntu 16.04, pytorch 1.0

[thomwolf]

I will add a section in the readme detailing how to load a model from drive. Basically, you can just download the models and vocabulary from our S3 following the links at the top of each file (modeling_transfo_xl.py and tokenization_transfo_xl.py for Transformer-XL) and put them in one directory with the filename also indicated at the top of each file.

Here is the process in your case:

mkdir model
cd model
wget -O pytorch_model.bin https://s3.amazonaws.com/models.huggingface.co/bert/transfo-xl-wt103-pytorch_model.bin
wget -O config.json https://s3.amazonaws.com/models.huggingface.co/bert/transfo-xl-wt103-config.json
wget -O vocab.bin https://s3.amazonaws.com/models.huggingface.co/bert/transfo-xl-wt103-vocab.bin
# optional, only if you run the evaluation script run_transfo_xl.py which uses the pre-processed wt103 corpus:
# wget -O corpus.bin https://s3.amazonaws.com/models.huggingface.co/bert/transfo-xl-wt103-corpus.bin

Now just load the model and tokenizer by pointing to this directory:

tokenizer = TransfoXLTokenizer.from_pretrained('./model/')
model = TransfoXLModel.from_pretrained('./model/')

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.