question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

ELK elasticsearch indexing

See original GitHub issue

The current scripts whereby tweets are loaded with logstash result in a long list of indices (of the form logstash-<date>. Elasticsearch seems to get hung up when loaded with >100K tweets. It seems to me that we should be creating one index (could be wrong here).

This may be what’s crashing Elasticsearch, which is preventing realistic use of the ELK container. It is a high-priority request from Program on Extremism to have the ELK container work for their data set, which currently consists of roughly 900,000 tweets.

Issue Analytics

  • State:closed
  • Created 7 years ago
  • Comments:14 (13 by maintainers)

github_iconTop GitHub Comments

1reaction
justinlittmancommented, Jan 25, 2017

Nope. ES indexes are stored outside of the container.

0reactions
kerchnercommented, Jan 31, 2017

@Tanych @justinlittman Thanks for your thorough testing and work on this.

Read more comments on GitHub >

github_iconTop Results From Across the Web

What is an Elasticsearch Index? | Elastic Blog
An index is like a 'database' in a relational database. It has a mapping which defines multiple types. An index is a logical...
Read more >
10 Elasticsearch Concepts You Need to Learn - Logz.io
The heart of any ELK setup is the Elasticsearch instance, which has the crucial task of storing and indexing data. In a cluster,...
Read more >
ELK : Elasticsearch Indexing Performance - 2020 - BogoToBogo
Indexing latency: Elasticsearch does not directly expose this particular metric, but monitoring tools can help us calculate the average indexing latency from ...
Read more >
How to Create Elasticsearch Indices - Linux Hint
Elasticsearch is one part of the popular ELK stack used for log analytics and search. Applications and systems are constantly logging data that...
Read more >
Elasticsearch Index - How to Create, Delete, List & Query Indices
How to create an Elasticsearch Index & what it is with a general overview - an index (plural: indices) contains a schema and...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found