Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
File Datalake Client get_path() iterator returning no more than 5000 blob paths
See original GitHub issueBug Description get_path() returning up to 5000 blob paths, even with max_results set to something > 5000.
Reproduction
cred = ClientSecretCredential(tenant_id, client_id, client_secret) storage_account_name = 'ADLSAccount' path = 'dir' service_client = DataLakeServiceClient(account_url='{}://{}.dfs.core.windows.net'.format('https', storage_account_name), credential=cred) file_system_client = service_client.get_file_system_client(file_system='samplecontainer') result = file_system_client.get_paths(path, recursive=True, max_results=10000)
Only 5000 paths are included in ‘path’.
Expected Behavior Datalake service pagination logic should support client-side configuration, at least for the Python client.
Issue Analytics
- State:
- Created 3 years ago
- Comments:9 (4 by maintainers)
Top Results From Across the Web
Top Related Medium Post
Top Related StackOverflow Question
Troubleshoot Live Code
Top Related Reddit Thread
Top Related Hackernoon Post
Top Related Tweet
Top Related Dev.to Post
Top Related Hashnode Post
Thanks for the feedback, we’ll investigate asap.
Hi, we’re sending this friendly reminder because we haven’t heard back from you in a while. We need more information about this issue to help address it. Please be sure to give us your input within the next 7 days. If we don’t hear back from you within 14 days of this comment the issue will be automatically closed. Thank you!