Wrong error message during finetuning

Rasa Open Source version

3.0.0rc2

Rasa SDK version

No response

Rasa X version

No response

Python version

3.8

What operating system are you using?

OSX

What happened?

Started with a rasa init project which trained an initial model. I made changes to the NLU training data by adding a new intent:

- intent: new_intent
  examples: |
    - yes i am new
    - can i break you
    - i don't think i want to do this
    - but its exciting

Ran rasa train --finetune. The process exits with:

InvalidConfigException: Cannot finetune because more than just the 'epoch' keys have been changed in the configuration. Please revert your configuration and only change the 'epoch' settings where needed.

whereas according to 2.8.x, the log should have been:

2021-11-16 15:44:23 INFO     rasa.model  - Data (nlu_labels) for finetune section changed.
NLU model can not be finetuned.

which is the correct info as we only changed the data and added a new intent label which should disallow finetuning.

Command / Request

rasa train --finetune

Relevant log output

No response

[dakshvar22]

It still doesn’t explain why you got the config mismatch error message, rather than the nlu mismatch error message

Yep, that should be investigated and fixed 😄

[ka-bu]

Problem seems to be that in the default project, we fill in [“debug_plots”, “augmentation_factor”] but for some reason those parameters are not set when running rasa init – Guess that comes from some mismatch of defaults for those cli parameters.