http endpoints become unresponsive while nlu model is updating
See original GitHub issueRasa version: Rasa 1.1.4
Python version: Python 3.7.2
Operating system: macOS 10.13.5
Issue:
I am using rasa as an nlu service only. When configuring automatic model pulling, the /model/parse
endpoint becomes unresponsible for a few seconds while the model is training.
From glancing at the code, the model pulling and update should happen in the background (using apscheduler
) but it appears to still block standard request handling.
This issue also happens when using the PUT /model
endpoint to load a model from e.g. S3 or when configuring Sanic to use multiple workers (app.run(..., workers=4)
).
endpoints.yml
models:
url: http://localhost:5001/model
wait_time_between_pulls: 10
Command or request that led to error:
rasa run --enable-api -p 5000 --endpoints endpoints.yml --credentials credentials.yml
Issue Analytics
- State:
- Created 4 years ago
- Comments:16 (13 by maintainers)
Top Results From Across the Web
Tuning Your NLU Model - Rasa
In Rasa, incoming messages are processed by a sequence of components. These components are executed one after another in a so-called processing ...
Read more >Train and publish the NLU model for the People Genius ...
Train and publish the NLU model used by the NLU trigger for the People default Genius Result configuration.
Read more >What is the correct way of using RASA's API (rasa.core ...
To access the REST endpoint, you should use the rasa run command instead. That will start a Rasa server, enabling any channels you've ......
Read more >Troubleshooting online endpoints deployment and scoring
You will get this error message if it's not available when you trigger kubernetes online endpoint and deployment creation/update request. Please ...
Read more >Using the DIET classifier for intent classification in dialogue
After training, your model will be saved in the ./models folder. Testing the NLU model: You can quickly try out the trained model...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Could you please do that? (no rush)
I understood this part 😀