question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Error training a model for Named Entity Recognition Tagging

See original GitHub issue

I am trying to train a NER model with this configuration:

input_features:
    -
        name: utterance
        type: text
        level: word
        encoder: rnn
        cell_type: lstm
        reduce_output: null
        preprocessing:
          word_tokenizer: space

output_features:
    -
        name: tag
        type: sequence
        decoder: tagger

The error that I am seeing is:

StagingError: in user code:

    /usr/local/lib/python3.6/dist-packages/ludwig/models/ecd.py:176 train_step  *
        model_outputs = self((inputs, targets), training=True)
    /usr/local/lib/python3.6/dist-packages/ludwig/models/ecd.py:118 call  *
        decoder_outputs = decoder(
    /usr/local/lib/python3.6/dist-packages/ludwig/features/base_feature.py:271 call  *
        logits = self.logits(logits_input, target=target, training=training)
    /usr/local/lib/python3.6/dist-packages/ludwig/features/sequence_feature.py:243 logits  *
        inputs,
    /usr/local/lib/python3.6/dist-packages/ludwig/decoders/sequence_decoders.py:785 _logits_training  *
        return self.call(inputs, training=training, mask=mask)
    /usr/local/lib/python3.6/dist-packages/ludwig/decoders/sequence_decoders.py:774 call  *
        LENGTHS: inputs[LENGTHS]

The input data looks like this:

{
  'utterance': 'Jury awards more than $ 37M to family of Korryn Gaines in civil case against Baltimore County', 
  'tag': 'O O O O O O O O O PERSON PERSON O O O O LOCATION LOCATION'
}

OS: Ubuntu 18.04.5 LTS Ludwig version: 0.3.3 Python version: 3.6.9

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:5

github_iconTop GitHub Comments

1reaction
jimthompson5802commented, Feb 24, 2021

@plantroots Thank you for submitting the issue. Using the information you provided, I’m able to recreate the issue.

We’ll now have to do a more deeper dive to identify root cause and a solution.

0reactions
w4nderlustcommented, Mar 11, 2021

The issue is solved, so the next release of Ludwig will contain the fix. In the meantime you can install Ludwig from the git repo: pip uninstall ludwig & pip install gut+http://github.com/ludwig-ai/ludwig.git

Read more comments on GitHub >

github_iconTop Results From Across the Web

Named Entity Recognition Tagging - CS230 Deep Learning
We explore the problem of Named Entity Recognition (NER) tagging of sentences. The task is to tag each token in a given sentence...
Read more >
Issues with reusing tags file generated by language studio
I recently created some training data to train a NLP model for named entity recognition using Azure Cognitive Service for custom entity ...
Read more >
Building a Named Entity Recognition model using a BiLSTM ...
In this blog post we present the Named Entity Recognition problem and show how a BiLSTM-CRF model can be fitted using a freely...
Read more >
Training Pipelines & Models · spaCy Usage Documentation
Every “decision” these components make – for example, which part-of-speech tag to assign, or whether a word is a named entity – is...
Read more >
Extensive Error Analysis and a Learning-Based Evaluation of ...
Using the training dataset of the. NER model, we train an entity classifier with gold standard entities as inputs and their assigned tags...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found