question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Predicted intent is always 'greet' for every message that doesn't exists in the training data

See original GitHub issue

Rasa Open Source version

2.8.12

Rasa SDK version

No response

Rasa X version

No response

Python version

3.8

What operating system are you using?

Linux

What happened?

‘greet’ intent always return as the selected intent with confidence 1 when user types a message that doesn’t exists in the training data.

nlu.yml

version: "2.0"
nlu:
  - intent: greet
    examples: |
      - γεια
      - γεια σας
      - καλησπέρα
      - καλημερα
      - kalispera
      - geia
      - geia sas
      - kalimera
      - hey
      - hello
      - hi
      - hello there
      - good morning
      - good evening
      - hey dude
      - goodmorning
      - goodevening
      - good afternoon
  - intent: affirm
    examples: |
      - yes
      - sure

domain.yml is the default config.yml is the default + added FallbackClassifier with threshold 0.3

User input: “I am writting something”

predicted intent is always “greet”

image

Command / Request

No response

Relevant log output

No response

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:9 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
koaningcommented, Nov 8, 2021

My gut says that adding more examples will go a long way. I’d try having at least 12 examples per intent. At the moment, the model may be overfitting on the few examples that exist and is thus learning only to output high confidence values.

0reactions
koaningcommented, Nov 10, 2021

I’ll close this issue since it doesn’t seem like Rasa is directly breaking here.

If you’d like to discuss this issue further, please start a thread on our forum at https://forum.rasa.com. That’s a preferable place to talk about specific bot issues. You can ping me via my @koaning user name there as well.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Fallback Policy always falls back · Issue #5356 · RasaHQ ...
Rasa is always using the fallback action no matter the confidence level in the predicted intent. In the logs below you can see...
Read more >
Training Data Format
A user message, represented by intent and entities. · An or statement, which includes two or more user messages under it. · A...
Read more >
Training Analytics
All the expressions inside each intent are evaluated. This results in three metrics between 0 and 1 for each intent (precision, recall, and...
Read more >
THE RASA MASTERCLASS HANDBOOK
The EmbeddingIntentClassifier works by feeding user message inputs and intent labels from training data into two separate neural networks which each terminate ...
Read more >
How Qualtrics Leveraged Drift and 6sense Insights in Their ...
“We had all the traditional channels set up for users to get in touch with ... Qualtrics to segment intent-based audiences in 6sense,...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found