Scan & Scroll w/o Skipping the First Lines?

Hopefully this is an easy one.

I’m scanning & scrolling as such:

  var scanResults = esClient.Search<DeliveryEvent>(s => s
                .From(0)
                .Size(10)
                .MatchAll()
                .Query(q => q.Term(f => f.UserID, user)
                    && q.Range(r => r.OnField(f => f.ReceivedAt).From("2013-03-06T00:00:00.000-05:00").To("2013-03-25T00:00:00.000-05:00")))
                .SearchType(Nest.SearchType.Scan)
                .Scroll("60m")
            );

            var results = esClient.Scroll<DeliveryEvent>("1m", scanResults.ScrollId);
            while (results.Documents.Any())
            {
                results = esClient.Scroll<DeliveryEvent>("1m", results.ScrollId);

                do some more stuff 
                }
            }

I’d like to scroll by a larger number than 10 but if I set the number high, the first scroll ( var results = esClient.Scroll<DeliveryEvent>(“1m”, scanResults.ScrollId)😉 sets it ahead too far and I miss documents. Is there a way to structure this so that the first scroll I’m doing work on is at the beginning? I borrowed this structure from the NEST tests so hopefully I’m setting it up right.

Thx!

[jptoto]

I haven’t used the clear scroll API before. As long as the file descriptors are set high on your ES servers, and they should be, It shouldn’t be a problem. You can also set the scrolls to expire sooner. In the example I gave it’s set to 20 minutes.

[jptoto]

@nasreekar Glad it’s working! That cold was a bit old so perhaps the namespaces are a bit different now. Glad I could help.