Label Studio AssertionError while Submitting Annotation [label_studio_ml.model::get_result::58]
See original GitHub issueHi,
I have implemented a text classification
task with two class classifications and connected label-studio-ml-backend
with the label-studio
. The Training
and Prediction Retrieval
task is being done correctly. The only issue is is retraining after each annotation submission.
It is throwing the following error
[2022-08-21 01:20:41,152] [ERROR] [label_studio_ml.model::get_result::58]
Traceback (most recent call last):
File "...\anaconda3\envs\ls\lib\site-packages\label_studio_ml\model.py", line 56, in get_result
job_result = self.get_result_from_job_id(model_version)
File "...\anaconda3\envs\ls\lib\site-packages\label_studio_ml\model.py", line 110, in get_result_from_job_id
assert isinstance(result, dict)
ML Model Setting is as follows
Seems like get_result
method in JobManager
Class is not able to get the annotation result.
This is also sending empty data in fit(self, completions, workdir=None, **kwargs)
method as shown below. I have used print statements to print these on the console for debugging.
***************-------FIT -----***********
completions -> ()
***************-------END-----***********
Label set has been changed:[]
***************-------FIT -----***********
input_text []
output_labels []
output_labels_idx []
***************-------END-----***********
Since input data is empty therefore fit is throwing the following error while doing model.fit()
ValueError: empty vocabulary; perhaps the documents only contain stop words
Any word of advice would be appreciable!
Issue Analytics
- State:
- Created a year ago
- Comments:6 (3 by maintainers)
Top Results From Across the Web
Label Studio Documentation — Troubleshoot Machine Learning
Troubleshoot Label Studio connections with machine learning frameworks using the Label Studio ML backend SDK.
Read more >ML Backend Error - Using Example Docker #1731 - GitHub
Go to the label-studio UI and open settings for project; Click on 'Machine Learning'; Scroll down to 'Enter the backend details'; See error...
Read more >Generating High-Quality Labels for Speech Recognition with ...
ASR workflow with Label Studio and NeMo to annotate and correct transcripts ... cd label-studio-ml-backend # Install label-studio-ml and its ...
Read more >Enterprise Labeling Platform and Open Source Tools - Heartex
Label Studio enables you to build ground truth datasets, ... can submit empty annotations or edit their history - you control how Label...
Read more >Innovative Data Labeling Projects with Label Studio and ...
When you open your DagsHub repository, you can see an icon, similar to the image below. Image by Author. By clicking the Annotations...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Hi @askgitqa When you are using active learning your fit method get only an event that you shoud handle. Check this example.
This issue is not connected with train issue, it tells that some of your training sessions ended without result and can’t be used as checkpoint.