question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Ability to index documents incrementally

See original GitHub issue

This patch provides the ability to add documents incrementally by using a new add method in conjunction with an identifyItem function. It does this by keeping track of the item ids in the indexmap dictionary where the values are the position into the index of where the item lives.

0001-Provide-the-ability-to-incrementally-add-to-the-inde.patch.zip

Additionally, this patch moves grunt into devDependencies instead of as a dependency.

0002-Make-grunt-a-devDependency.patch.zip

Issue Analytics

  • State:closed
  • Created 6 years ago
  • Comments:8 (8 by maintainers)

github_iconTop GitHub Comments

2reactions
jeancroycommented, Jul 21, 2017

Hi @mrkishi thanks for your report !

I think it is now fixed. We preallocated the array in _prepSource but then pushed to the end of the array in add. So the whole preallocated space is undefined, which cause error when reading in loop

I’ve added a counter for item that are actually in use.

0reactions
mrkishicommented, Jul 21, 2017

That was way too fast, thanks! 💯

Took me days to notice it in the first place (since we don’t usually update git-based dependencies).

In any case, it’s on me for not pinning on a specific commit.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Fast Incremental Indexing for Full-Text Information Retrieval
A prerequisite to supporting a growing document collec- tion is the ability to update the data structures used to index the collection. An...
Read more >
Introducing incremental enrichment in Azure Cognitive Search
Incremental enrichment is a new feature of Azure Cognitive Search that brings a declarative approach to indexing your data.
Read more >
How to index documents - Whoosh - Read the Docs
Incremental indexing ¶ ... When you're indexing a collection of documents, you'll often want two code paths: one to index all the documents...
Read more >
Ability to flag documents for re-indexing during an ... - Idea
It would be nice to have the ability to flag documents for re-indexing during the next incremental dtSearch build. We often re-OCR documents...
Read more >
lucene: how to perform an incremental indexing and avoid ...
To perform incremental indexing, you should add the last-modified time stamp to the documents of your index, and only index documents that are...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found