helpers.scan not working (v7.0.3)

Hi I’m using Python 3.6.8 Since the last elasticsearch update I got an error with the scan method (with pyelasticsearch version 7.0.3).

The problem is that it is not scrolling.

In the previous version 7.0.2 it works perfectly.

Thank you in advance 😃

[honzakral]

Thank you for your patience, I realized the problem is that you are using an old version of the code which got accidentally released in the wheel version of package. I just release 7.0.4 which corrects the mistake. My apologies!

[fernaper]

I just did it, and this is the response:

python version: 3.6.8
elasticsearch-py version: (7, 0, 3)
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:9200
DEBUG:urllib3.connectionpool:http://localhost:9200 "GET /_all/_search?scroll=2m&size=10 HTTP/1.1" 200 4221
INFO:elasticsearch:GET http://localhost:9200/_all/_search?scroll=2m&size=10 [status:200 request:0.006s]
DEBUG:elasticsearch:> {"query":{"match_all":{}},"sort":"_doc"}
DEBUG:elasticsearch:< {"_scroll_id":"DnF1ZXJ5VGhlbkZldGNoGAAAAAAAAAUwFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFLhY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABUIWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAVFFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFLxY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABTEWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAUyFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFMxY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABTUWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAU0Fjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFNxY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABTYWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAU_Fjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFOBY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABTkWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAU7Fjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFOhY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABUMWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAU8Fjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFPRY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABT4WODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAVEFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFQBY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABUEWODFuX095d2pRcW1Od1VmUGNteGFCQQ==","took":2,"timed_out":false,"_shards":{"total":24,"successful":24,"skipped":0,"failed":0},"hits":{"total":{"value":13595081,"relation":"eq"},"max_score":null,"hits":[<10 first hits there>]}}
DEBUG:urllib3.connectionpool:http://localhost:9200 "GET /_search/scroll?scroll=2m HTTP/1.1" 400 672
WARNING:elasticsearch:GET http://localhost:9200/_search/scroll?scroll=2m [status:400 request:0.001s]
DEBUG:elasticsearch:> DnF1ZXJ5VGhlbkZldGNoGAAAAAAAAAUwFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFLhY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABUIWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAVFFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFLxY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABTEWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAUyFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFMxY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABTUWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAU0Fjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFNxY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABTYWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAU_Fjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFOBY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABTkWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAU7Fjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFOhY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABUMWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAU8Fjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFPRY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABT4WODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAVEFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFQBY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABUEWODFuX095d2pRcW1Od1VmUGNteGFCQQ==
DEBUG:elasticsearch:< {"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"Failed to parse request body"}],"type":"illegal_argument_exception","reason":"Failed to parse request body","caused_by":{"type":"json_parse_exception","reason":"Unrecognized token 'DnF1ZXJ5VGhlbkZldGNoGAAAAAAAAAUwFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFLhY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABUIWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAVFFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFLxY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABTEWODFuX095d2pRcW1O...': was expecting ('true', 'false' or 'null')\n at [Source: org.elasticsearch.transport.netty4.ByteBufStreamInput@414b042a; line: 1, column: 257]"}},"status":400}
DEBUG:urllib3.connectionpool:http://localhost:9200 "DELETE /_search/scroll HTTP/1.1" 200 33
INFO:elasticsearch:DELETE http://localhost:9200/_search/scroll [status:200 request:0.001s]
DEBUG:elasticsearch:> {"scroll_id":["DnF1ZXJ5VGhlbkZldGNoGAAAAAAAAAUwFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFLhY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABUIWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAVFFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFLxY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABTEWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAUyFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFMxY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABTUWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAU0Fjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFNxY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABTYWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAU_Fjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFOBY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABTkWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAU7Fjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFOhY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABUMWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAU8Fjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFPRY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABT4WODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAVEFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFQBY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABUEWODFuX095d2pRcW1Od1VmUGNteGFCQQ=="]}
DEBUG:elasticsearch:< {"succeeded":true,"num_freed":24}
Exception: {'error': {'root_cause': [{'type': 'illegal_argument_exception', 'reason': 'Failed to parse request body'}], 'type': 'illegal_argument_exception', 'reason': 'Failed to parse request body', 'caused_by': {'type': 'json_parse_exception', 'reason': "Unrecognized token 'DnF1ZXJ5VGhlbkZldGNoGAAAAAAAAAUwFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFLhY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABUIWODFuX095d2pRcW1Od1VmUGNteGFCQQAAAAAAAAVFFjgxbl9PeXdqUXFtTndVZlBjbXhhQkEAAAAAAAAFLxY4MW5fT3l3alFxbU53VWZQY214YUJBAAAAAAAABTEWODFuX095d2pRcW1O...': was expecting ('true', 'false' or 'null')\n at [Source: org.elasticsearch.transport.netty4.ByteBufStreamInput@414b042a; line: 1, column: 257]"}}, 'status': 400}

NOTE: I removed the 10 first hits from the output