question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Cannot export pre-annotated tasks

See original GitHub issue

Describe the bug I used the API to import already annotated data in Basic Label Studio JSON format. It worked well as the results are actually showing on each task and they are marked as annotated. When I try to export this tasks (through API or UI), I get an empty list. I tried to import only the data through API and annotate a few tasks through the UI, and the annotated tasks did showed up on the export. I then tried to update the annotation after importing pre-annotated tasks, but the export still fails.

To Reproduce Steps to reproduce the behavior:

  1. Import annotated data throught the API Ex payload I used : {"data": {"sentence": "SoftBank-backed OneWeb files for Chapter 11 bankruptcy plan, cuts jobs", "metadata": {}}, "annotations": [{"ground_truth": false, "result": [{"value": {"choices": ["Neutral"]}, "from_name": "sentiment", "to_name": "sentence", "type": "choices"}]}], "predictions": []}

Label config :

<View>
  <Text name="sentence" value="$sentence"/>
  <View style="box-shadow: 2px 2px 5px #999; padding: 20px; margin-top: 2em; border-radius: 5px;">
    <Header value="Choose text sentiment"/>
    <Choices name="sentiment" toName="sentence" choice="single" showInLine="true">
      <Choice value="Positive"/>
      <Choice value="Negative"/>
      <Choice value="Neutral"/>
    </Choices>
  </View>
</View>
  1. Export data throught API or UI, results in empty data

Expected behavior Pre-annotated tasks showing up in the export.

Environment (please complete the following information):

  • OS: linux
  • Label Studio Version == 1.0.1
  • Postgres DB in Docker

Thanks !

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:6 (2 by maintainers)

github_iconTop GitHub Comments

2reactions
makseqcommented, May 12, 2021

@Lauler @rizziemma Thank you for your report. This is a bug and it happens because the is_labeled statistic wasn’t re-calculated after import. I’ll hope we’ll fix it soon.

1reaction
rizziemmacommented, Jun 11, 2021

I’m very sorry for the delay I don’t know why I wasn’t notified by your response 😦 I will try it soon thanks for working on it !

Read more comments on GitHub >

github_iconTop Results From Across the Web

Import pre-annotated data into Label Studio
Import pre-annotated tasks into Label Studio using the UI or using the API. Troubleshoot pre-annotations. If annotators can't see predictions or if you ......
Read more >
Datasets and using pre-annotated data - Prodigy Support
To export the annotations, you can use the db-out command: ... of adding new labels to pre-annotated data and also imrove annotation task...
Read more >
Exporting your Microsoft To Do account
To export your lists and tasks, sign in to Outlook.com with the same Microsoft account that you use to sign in to Microsoft...
Read more >
Import & Export - Supervisely
... to a single Supervisely Format and Agents to run those tasks on scale. ... to export labeled data from Supervisely or upload...
Read more >
Pre-annotating documents with a dictionary - IBM Cloud Docs
Ground truth that is produced by documents that were pre-annotated by the Natural Language Understanding service cannot be used directly outside of Knowledge ......
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found