Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
Add Lemmatization
See original GitHub issueLemmatization can be thought of as a more advanced stemming that we already have in the preprocessing module. You can read about it e.g. here. Implementation should be done with spaCy.
ToDo
Implement a function hero.lemmatize(s: TokenSeries) (or mayber rather TextSeries?). Using spaCy this should be fairly straightforward. It should go into the NLP module and probably look very similar to the other spacy-based functions there.
Just comment below if you want to work on this and/or have any questions. I think this is a good first issue for new contributors.
Issue Analytics
- State:
- Created 3 years ago
- Reactions:1
- Comments:15 (5 by maintainers)
Top Results From Across the Web
Top Related Medium Post
Top Related StackOverflow Question
Troubleshoot Live Code
Top Related Reddit Thread
Top Related Hackernoon Post
Top Related Tweet
Top Related Dev.to Post
Top Related Hashnode Post
If the guys at spaCy decided to replace pronouns with -PRON- there must be a reason. I guess that’s because when we lemmatize a text, we want to normalize it. With the -PRON- token we are achieving this.
What I suggest is to keep as default their approach but to give the user the opportunity to replace -PRON- with the respective token throughout a
keep_pron(orkeep_pronouns) parameter or something similar.Hi, I would like to work on this issue.