Population-Density: Only list countries for download where data is available

So far, we have listed all countries using the i18n-iso-countries npm package. However, there is no data available for some countries, e.g., due to bad satellite imagery. Facebook constantly improves its approach and data so that they might add new countries in the future. Therefore, we should use the AWS CLI to only list countries where data is available to avoid an error during the processing.

The command for that is:

aws s3 ls --no-sign-request s3://dataforgood-fb-data/csv/month=2019-06/

This has to adapt to the month partition dynamically.

[tjukanovt]

Hi @mattigrthr! Have you thought about an option to user Kontur poulation grid instead? It contains GHSL and more and it is already aggregated to H3 grids.

Link to the data: https://data.humdata.org/dataset/kontur-population-dataset

[mattigrthr]

This issue has been resolved by switching the file download to the hdx Python package. The file downloader can be found in kuwala/common/python_utils/src/FileSelector.py.