Predicted intent is always 'greet' for every message that doesn't exists in the training data
See original GitHub issueRasa Open Source version
2.8.12
Rasa SDK version
No response
Rasa X version
No response
Python version
3.8
What operating system are you using?
Linux
What happened?
‘greet’ intent always return as the selected intent with confidence 1 when user types a message that doesn’t exists in the training data.
nlu.yml
version: "2.0"
nlu:
- intent: greet
examples: |
- γεια
- γεια σας
- καλησπέρα
- καλημερα
- kalispera
- geia
- geia sas
- kalimera
- hey
- hello
- hi
- hello there
- good morning
- good evening
- hey dude
- goodmorning
- goodevening
- good afternoon
- intent: affirm
examples: |
- yes
- sure
domain.yml is the default config.yml is the default + added FallbackClassifier with threshold 0.3
User input: “I am writting something”
predicted intent is always “greet”
Command / Request
No response
Relevant log output
No response
Issue Analytics
- State:
- Created 2 years ago
- Comments:9 (5 by maintainers)
Top Results From Across the Web
Fallback Policy always falls back · Issue #5356 · RasaHQ ...
Rasa is always using the fallback action no matter the confidence level in the predicted intent. In the logs below you can see...
Read more >Training Data Format
A user message, represented by intent and entities. · An or statement, which includes two or more user messages under it. · A...
Read more >Training Analytics
All the expressions inside each intent are evaluated. This results in three metrics between 0 and 1 for each intent (precision, recall, and...
Read more >THE RASA MASTERCLASS HANDBOOK
The EmbeddingIntentClassifier works by feeding user message inputs and intent labels from training data into two separate neural networks which each terminate ...
Read more >How Qualtrics Leveraged Drift and 6sense Insights in Their ...
“We had all the traditional channels set up for users to get in touch with ... Qualtrics to segment intent-based audiences in 6sense,...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
My gut says that adding more examples will go a long way. I’d try having at least 12 examples per intent. At the moment, the model may be overfitting on the few examples that exist and is thus learning only to output high confidence values.
I’ll close this issue since it doesn’t seem like Rasa is directly breaking here.
If you’d like to discuss this issue further, please start a thread on our forum at https://forum.rasa.com. That’s a preferable place to talk about specific bot issues. You can ping me via my @koaning user name there as well.