Zarr custom Reader?
See original GitHub issuewith the release of GDAL 3.4, the Zarr driver is now available by default, which mean that rasterio/rio-tiler can now open/read Zarr files.
Why do we need a custom reader
- Zarr format can be quite different from a COG or other raster format because it’s not restricted to 2D dataset.
If the Zarr dataset contains one single array with 2 dimensions, it will be exposed as a regular GDALDataset when using the classic raster API. If the dataset contains more than one such single array, or arrays with 3 or more dimensions, the driver will list subdatasets to access each array and/or 2D slices within arrays with 3 or more dimensions.
ref: https://gdal.org/drivers/raster/zarr.html#particularities-of-the-classic-raster-api
- No Overviews
Because there is no overview (currently in dev) we cannot fetch lower resolution
of the data and should restrict to one zoom level
Issue Analytics
- State:
- Created 2 years ago
- Comments:6 (5 by maintainers)
Top Results From Across the Web
Tutorial — zarr 2.13.3 documentation - Read the Docs
Zarr arrays support a similar interface to NumPy arrays for reading and writing ... Here is an example using LZMA with a custom...
Read more >xarray Internals
xarray can wrap custom duck array objects as long as they define numpy's shape ... When reading a Zarr group, Xarray looks for...
Read more >Reading and writing files - Xarray
Xarray's Zarr backend allows xarray to leverage these capabilities, including the ability to store and analyze datasets far too large fit onto ...
Read more >Zarr files and L5kit data for dummies - Kaggle
Zarr arrays support a similar interface to NumPy arrays for reading and writing data. ... Zarr arrays and groups support custom key/value attributes, ......
Read more >Create Dask Arrays - Dask documentation
Load array from the zarr storage format ... it is ideal for parallel access in both reading and writing (for the latter, ......
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
@vincentsarago I’m giving up on hierarchical data in rasterio. See https://github.com/rasterio/rasterio/issues/1759#issuecomment-1294298813. It seems like a lot of wasted effort on redundant Python software. I know I have flip-flopped on this in the past, but now I believe that using zarr (python) or h5py is the way to go.
thanks for trying @sgillies. I commented on the issue directly.