question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Label Studio AssertionError while Submitting Annotation [label_studio_ml.model::get_result::58]

See original GitHub issue

Hi, I have implemented a text classification task with two class classifications and connected label-studio-ml-backend with the label-studio. The Training and Prediction Retrieval task is being done correctly. The only issue is is retraining after each annotation submission. It is throwing the following error

[2022-08-21 01:20:41,152] [ERROR] [label_studio_ml.model::get_result::58] 
Traceback (most recent call last):
  File "...\anaconda3\envs\ls\lib\site-packages\label_studio_ml\model.py", line 56, in get_result
    job_result = self.get_result_from_job_id(model_version)
  File "...\anaconda3\envs\ls\lib\site-packages\label_studio_ml\model.py", line 110, in get_result_from_job_id
    assert isinstance(result, dict)

ML Model Setting is as follows image

Seems like get_result method in JobManager Class is not able to get the annotation result.

This is also sending empty data in fit(self, completions, workdir=None, **kwargs) method as shown below. I have used print statements to print these on the console for debugging.

***************-------FIT -----***********
completions -> ()
***************-------END-----***********

Label set has been changed:[]

***************-------FIT -----***********
input_text []
output_labels []
output_labels_idx []
***************-------END-----***********

Since input data is empty therefore fit is throwing the following error while doing model.fit()

ValueError: empty vocabulary; perhaps the documents only contain stop words

Any word of advice would be appreciable!

Issue Analytics

  • State:closed
  • Created a year ago
  • Comments:6 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
KonstantinKorotaevcommented, Sep 6, 2022

Hi @askgitqa When you are using active learning your fit method get only an event that you shoud handle. Check this example.

0reactions
KonstantinKorotaevcommented, Sep 7, 2022

This issue is still unresolved [label_studio_ml.model::get_result::58]

This issue is not connected with train issue, it tells that some of your training sessions ended without result and can’t be used as checkpoint.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Label Studio Documentation — Troubleshoot Machine Learning
Troubleshoot Label Studio connections with machine learning frameworks using the Label Studio ML backend SDK.
Read more >
ML Backend Error - Using Example Docker #1731 - GitHub
Go to the label-studio UI and open settings for project; Click on 'Machine Learning'; Scroll down to 'Enter the backend details'; See error...
Read more >
Generating High-Quality Labels for Speech Recognition with ...
ASR workflow with Label Studio and NeMo to annotate and correct transcripts ... cd label-studio-ml-backend # Install label-studio-ml and its ...
Read more >
Enterprise Labeling Platform and Open Source Tools - Heartex
Label Studio enables you to build ground truth datasets, ... can submit empty annotations or edit their history - you control how Label...
Read more >
Innovative Data Labeling Projects with Label Studio and ...
When you open your DagsHub repository, you can see an icon, similar to the image below. Image by Author. By clicking the Annotations...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found