question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Migrate `LanguageModelFeaturizer` to GraphComponent interface

See original GitHub issue

Overview of the Solution: Adapt the LanguageModelFeaturizer to the new GraphComponent interface. See the implementation proposal for further details.

  • adapt create ~and load~ functions new signatures
  • implement required_packages and supported_languages
  • ~adapt persistence~
  • rename train to process_training_data (this featurizer only adds features but doesn’t require training)
  • support multiple messages in process (make sure to handle empty messages)

Definition of Done:

  • LanguageModelFeaturizer adapted to the new GraphComponent interface
  • Unit tests are adapted to adapted component
  • Other tests (integration tests, etc.) don’t break (because they’d (for now) still use the old component implementation)

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:7 (7 by maintainers)

github_iconTop GitHub Comments

1reaction
wochingecommented, Sep 10, 2021

The featurizer doesn’t need persisting, so you can omit the persist method. Only components which train themselves need a persist method

1reaction
wochingecommented, Sep 8, 2021

No, that’s not needed

Read more comments on GitHub >

github_iconTop Results From Across the Web

Version Migration Guide
This page contains information about changes between major versions and how you can migrate from one version to another.
Read more >
Migrate `CRFEntityExtractor` to `GraphComponent` interface
Overview of the Solution: Adapt the CRFEntityExtractor to the new GraphComponent interface. See the implementation proposal for further details.
Read more >
Using German GPT-2 in Rasa
GraphComponentException: Error initializing graph component for node run_LanguageModelFeaturizer1.``` rasa · rasa-nlu · language-model · Share.
Read more >
Rasa面试系列之: Rasa NLU意图和实体-特征提取器- ...
密集特征:由许多预先训练的嵌入词向量组成。通常来自SpacyFeatureizers或来自huggingface及LanguageModelFeaturizers,应在管道中包含适当的标记器。
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found