question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Scroll Id too long

See original GitHub issue

My cluster has roughly 1500 shards. When trying to scan and scroll through the entire cluster, we get an error saying that the looks like this

Elasticsearch ERROR: 2015-05-22T19:16:42Z
  Error: Request complete with error -- socket hang up
      at Log.error (/home/osman/node_modules/elasticsearch-tools/node_modules/elasticsearch/src/lib/log.js:213:60)
      at checkRespForFailure (/home/osman/node_modules/elasticsearch-tools/node_modules/elasticsearch/src/lib/transport.js:197:18)
      at HttpConnector.<anonymous> (/home/osman/node_modules/elasticsearch-tools/node_modules/elasticsearch/src/lib/connectors/http.js:146:7)
      at ClientRequest.bound (/home/osman/node_modules/elasticsearch-tools/node_modules/elasticsearch/node_modules/lodash-node/modern/internals/baseBind.js:56:17)
      at ClientRequest.emit (events.js:95:17)
      at Socket.socketOnEnd [as onend] (http.js:1573:9)
      at Socket.g (events.js:180:16)
      at Socket.emit (events.js:117:20)
      at _stream_readable.js:944:16
      at process._tickCallback (node.js:442:13)


  error: {"message":{"code":"ECONNRESET"}}

Upon further research, it looks like the scroll id is tied to the number of shards that you are scrolling through and there doesn’t seem to be a way for the scroll id to be put into the request body in the node.js API, which would fix the issue.

Issue Analytics

  • State:closed
  • Created 8 years ago
  • Comments:7 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
delvedorcommented, Jul 9, 2020

@fabiano-amaral if you pass the scroll_id in the body, you will solve the issue 😃

0reactions
delvedorcommented, Jul 9, 2020

It should!

Read more comments on GitHub >

github_iconTop Results From Across the Web

Scroll id returned by Scroll API is too long - Stack Overflow
Since the scroll id is too long, I cannot pass it on to the Scroll API to fetch the next batch of results....
Read more >
Scroll Id is too long - Java Api - Elasticsearch - Elastic Discuss
I am using a search with scroll with the Java API, when I come to call the scroll for the following data through...
Read more >
Scroll API - Oracle Help Center
If more than scrollTTL milliseconds elapse between subsequent scroll requests, the scroll session is cleaned up and any further usage of the session...
Read more >
scroll-behavior - CSS: Cascading Style Sheets - MDN Web Docs
The scroll-behavior CSS property sets the behavior for a scrolling box when scrolling is triggered by the navigation or CSSOM scrolling APIs ...
Read more >
Scroll
In order to use scrolling, the initial search request should specify the scroll parameter in the query string, which tells Elasticsearch how long...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found