ADLS Gen2 FileSystemClient.get_paths() returns only 5000 paths (1 page in PageIterator)

• Package Name: azure.storage.filedatalake
• Package Version: 12.2.2
• Operating System: Azure Databricks, Ubuntu 16.04.6LTS
• Python Version: 3.7.3

Describe the bug After getting FileSystemClient of particular container in ADLS Gen2, that contains more than 5000 files & folders, I am trying to retrieve all paths from this container using get_paths() method, which returns me the iterator, that contains only 5000 items of PathProperties or only 1 page in case I am using by_page() method.

To Reproduce Steps to reproduce the behavior:

1. Connect to the ADLS Gen2 Storage - in my case I used DataLakeServiceClient with storage account key as credential.
2. Get the FileSystemClient of Container which contains >5000 files & folders using get_file_system_client() method.
3. Use get_paths() method to get the PathProperties iterator.
4. Check the number of retreived paths after transforming iterator to list
5. Optional: Check the number of Pages of retreived paths using by_pages() method.

Expected behavior I excpect to get the iterator of PathProperties with correct number of items corresponding to the particular container (>5000). Optional: I excpect to get the PageIterator with correct number pages (>1) in case of container contains >5000 paths.

Screenshots

[tasherif-msft]

Hi @siarblack, datalake 12.2.3 has been released!

[tasherif-msft]

Hi @siarblack the fix got merged and we will be doing a patch release for this very soon. I will keep you updated.