NLU difference between 1.2.x and 1.3.x
See original GitHub issueRasa version: 1.2.9 and 1.3.6
Rasa X version (if used & relevant): -
Python version: 3.6.8
Operating system (windows, osx, …): ubuntu 18
Issue:
When training an NLU in 1.2.9, I can use it as expected. When training in 1.3.6 with the same .md file, I always get the same intent as output.
My training markdown file is here on pastebin.
Command or request that led to error:
rasa train nlu --config config.yml --nlu FILE
Content of configuration file (config.yml) (if relevant):
# Configuration for Rasa NLU.
language: nl
pipeline: supervised_embeddings
# Configuration for Rasa Core.
# https://rasa.com/docs/rasa/core/policies/
policies:
- name: MemoizationPolicy
- name: KerasPolicy
- name: MappingPolicy
Testrun in shell of 1.3.6:
Next message:
Is er een virtuele rondleiding mogelijk?
{
"intent": {
"name": "9",
"confidence": 0.125
},
"entities": [],
"intent_ranking": [
{
"name": "9",
"confidence": 0.125
},
{
"name": "77",
"confidence": 0.125
},
{
"name": "71",
"confidence": 0.125
},
{
"name": "61",
"confidence": 0.125
},
{
"name": "54",
"confidence": 0.125
},
{
"name": "48",
"confidence": 0.125
},
{
"name": "33",
"confidence": 0.125
},
{
"name": "1",
"confidence": 0.125
}
],
"text": "Is er een virtuele rondleiding mogelijk?"
}
As you can see, everything has the same confidence, which is quite illogical.
Testrun in shell of 1.2.9:
Next message:
Is er een virtuele rondleiding mogelijk?
{
"intent": {
"name": "71",
"confidence": 0.957551121711731
},
"entities": [],
"intent_ranking": [
{
"name": "71",
"confidence": 0.957551121711731
},
{
"name": "77",
"confidence": 0.05605613812804222
},
{
"name": "33",
"confidence": 0.025996943935751915
},
{
"name": "9",
"confidence": 0.023518487811088562
},
{
"name": "48",
"confidence": 0.0
},
{
"name": "61",
"confidence": 0.0
},
{
"name": "1",
"confidence": 0.0
},
{
"name": "54",
"confidence": 0.0
}
],
"text": "Is er een virtuele rondleiding mogelijk?"
}
What did I do wrong?
Issue Analytics
- State:
- Created 4 years ago
- Comments:6 (3 by maintainers)
Top Results From Across the Web
Rasa Open Source Change Log
All notable changes to this project will be documented in this file. This project adheres to Semantic Versioning starting with version 1.0.
Read more >Advantages of Natural Language Understanding (NLU) over ...
NLU helps Virtual Agent to process human language based on context and your company's data. With NLU, what the user needs can be...
Read more >How Different Are They? Comparing Preparation Offered by ...
Drawing on surveys of nearly 800 preservice student teachers. (PSTs) and their mentor teachers, we compare traditional, alternative, and residency pathways.
Read more >NLP vs NLU: What's The Difference? – BMC Software | Blogs
In this context, another term which is often used as a synonym is Natural Language Understanding (NLU). Actually, though, NLP and NLU focus ......
Read more >Enabling Near Real-Time NLU-Driven Natural Language ...
of NLU-driven NL programming, and provides a solution ... By definition, a CGT is a subgraph ... time(x) shows the total time needed...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
@Lambik Should be out with 1.3.9, in a day at the most.
@dakshvar22 thanks for fixing it ❤️ When will I be able to use it? (just did
pip3 install --upgrade rasa
, got 1.3.8, still the same issue after retraining the model)