Token Seperation Issue
See original GitHub issueI have discovered an issue when tokenize
and matchAllTokens
is enabled. When you search for white
(with a trailing whitespace), the tokens
are ['white', '']
. This causes fuse to return no results due to one empty token. Would removing empty tokens as below be a fix for this?
var tokens = pattern.split(options.tokenSeparator).filter(function(token){
return token !== '';
})
Issue Analytics
- State:
- Created 7 years ago
- Reactions:5
- Comments:7 (1 by maintainers)
Top Results From Across the Web
A LOOK BACK;Token Separation Anxiety - The New York Times
This unwillingness to part with old tokens is nothing new. Of the bulls-eye's two immediate predecessors, there are about 16 million tokens that ......
Read more >Separation of circulating tokens - ScienceDirect.com
vestigation is confined to the problem of self-stabilizing circulation of tokens with some desired separation between them. Related work.
Read more >Separation of Circulating Tokens | SpringerLink
The problem studied in this paper is to ensure that a synchronous system with m circulating tokens has at least d distance between...
Read more >[0908.1797] Separation of Circulating Tokens - arXiv
The problem studied in this paper is to ensure that a synchronous system with m circulating tokens has at least d distance between...
Read more >Is the separation token absolutely necessary if I use ... - GitHub
h56cho opened this issue on Jun 1, 2020 · 1 comment ... do I absolutely need to insert a special separation token between...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
I solved this by using
String.prototype.trim()
on my search query to remove unwanted leading /trailing whitespace.@jeffal I pulled in and re-built with the most recent master changes. Thank god Travis-CI didn’t fall off a cliff this time and built successfully.
Just needs a merge.