question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

NLU difference between 1.2.x and 1.3.x

See original GitHub issue

Rasa version: 1.2.9 and 1.3.6

Rasa X version (if used & relevant): -

Python version: 3.6.8

Operating system (windows, osx, …): ubuntu 18

Issue:

When training an NLU in 1.2.9, I can use it as expected. When training in 1.3.6 with the same .md file, I always get the same intent as output.

My training markdown file is here on pastebin.

Command or request that led to error:

rasa train nlu --config config.yml --nlu FILE

Content of configuration file (config.yml) (if relevant):

# Configuration for Rasa NLU.
language: nl
pipeline: supervised_embeddings

# Configuration for Rasa Core.
# https://rasa.com/docs/rasa/core/policies/
policies:
  - name: MemoizationPolicy
  - name: KerasPolicy
  - name: MappingPolicy

Testrun in shell of 1.3.6:

Next message:
Is er een virtuele rondleiding mogelijk?
{
  "intent": {
    "name": "9",
    "confidence": 0.125
  },
  "entities": [],
  "intent_ranking": [
    {
      "name": "9",
      "confidence": 0.125
    },
    {
      "name": "77",
      "confidence": 0.125
    },
    {
      "name": "71",
      "confidence": 0.125
    },
    {
      "name": "61",
      "confidence": 0.125
    },
    {
      "name": "54",
      "confidence": 0.125
    },
    {
      "name": "48",
      "confidence": 0.125
    },
    {
      "name": "33",
      "confidence": 0.125
    },
    {
      "name": "1",
      "confidence": 0.125
    }
  ],
  "text": "Is er een virtuele rondleiding mogelijk?"
}

As you can see, everything has the same confidence, which is quite illogical.

Testrun in shell of 1.2.9:

Next message:
Is er een virtuele rondleiding mogelijk?
{
  "intent": {
    "name": "71",
    "confidence": 0.957551121711731
  },
  "entities": [],
  "intent_ranking": [
    {
      "name": "71",
      "confidence": 0.957551121711731
    },
    {
      "name": "77",
      "confidence": 0.05605613812804222
    },
    {
      "name": "33",
      "confidence": 0.025996943935751915
    },
    {
      "name": "9",
      "confidence": 0.023518487811088562
    },
    {
      "name": "48",
      "confidence": 0.0
    },
    {
      "name": "61",
      "confidence": 0.0
    },
    {
      "name": "1",
      "confidence": 0.0
    },
    {
      "name": "54",
      "confidence": 0.0
    }
  ],
  "text": "Is er een virtuele rondleiding mogelijk?"
}

What did I do wrong?

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:6 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
dakshvar22commented, Oct 9, 2019

@Lambik Should be out with 1.3.9, in a day at the most.

0reactions
Lambikcommented, Oct 9, 2019

@dakshvar22 thanks for fixing it ❤️ When will I be able to use it? (just did pip3 install --upgrade rasa, got 1.3.8, still the same issue after retraining the model)

Read more comments on GitHub >

github_iconTop Results From Across the Web

Rasa Open Source Change Log
All notable changes to this project will be documented in this file. This project adheres to Semantic Versioning starting with version 1.0.
Read more >
Advantages of Natural Language Understanding (NLU) over ...
NLU helps Virtual Agent to process human language based on context and your company's data. With NLU, what the user needs can be...
Read more >
How Different Are They? Comparing Preparation Offered by ...
Drawing on surveys of nearly 800 preservice student teachers. (PSTs) and their mentor teachers, we compare traditional, alternative, and residency pathways.
Read more >
NLP vs NLU: What's The Difference? – BMC Software | Blogs
In this context, another term which is often used as a synonym is Natural Language Understanding (NLU). Actually, though, NLP and NLU focus ......
Read more >
Enabling Near Real-Time NLU-Driven Natural Language ...
of NLU-driven NL programming, and provides a solution ... By definition, a CGT is a subgraph ... time(x) shows the total time needed...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found