Huggingface transformers inference: ModuleNotFoundError: No module named 'generate'

When running the imports listed in transformers.md:

from PIL import Image
from torchvision import transforms
from transformers import OFATokenizer, OFAModel
from generate import sequence_generator

I get ModuleNotFoundError: No module named 'generate'

Where is generate supposed to come from? The implementations of sequence_generator.SequenceGenerator that I see in e.g. fairseq also don’t have the same signature, so it’s not clear how to proceed.

[JustinLin610]

Hi @Sultanax, sure. I did two things:

1. Added an empty __init__.py file in transformers/src/transformers/models/ofa/generate/__init__.py
2. Changed the import to be from transformers.models.ofa.generate import sequence_generator

Note: you will need to pip install OFA/transformers/ again

I have added the empty __init__.py to the directory generate and it all works now. If you guys are interested, you can try this notebook (link) and see if there are still any problems.

[JustinLin610]

Good suggestion! Thanks for helping us improve our repo. I’ll update the information to make things clear!