Cannot load labels from old models

❓ Questions & Help

If I load a model from 2.8 or older in 2.9 o newer, the labels from my model are changed automatically so all the tests in my code start to fail because instead of predicting I-PER it predicts LABEL_2.

After reading the source code I think I found what happens but I’m not quite sure. I think it all started here in #3967

https://github.com/huggingface/transformers/blob/e7cfc1a313cc928e962bb8699868f5dcf46f11eb/src/transformers/configuration_utils.py#L123

In the code above you can see that the labels dicts are modified if we set num_labels. I couldn’t find the place in the code where that is done, but it definetly modifies 2 attributes from the class. I don’t really think that a setter for attribute A, should change attributes B and C.

Am I missing something when loading my models?

Thanks you so much for reading and for the library, we all love it ❤️

[julien-c]

@GuillemGSubies Thanks for reporting, I can reproduce this issue.

To fix it on your side while we push a fix, you can just remove the num_labels attribute from your config.json, it’s not needed anymore. Let me know if this solves your issue.

[julien-c]

Should also be fixed on master by 751a1e08904fda197366e4b0033bdfb8b10d256c