[FEATURE] xarray integration + support for multidimensional arrays
See original GitHub issue🚨🚨 Feature Request
- Related to an existing Issue
- A new implementation (Improvement, Extension)
Add support for multidimensional arrays. A typical usage pattern is weather or climate data where the variables are feature arrays by latitude, longitude, time, and pressure level. Building on xarray’s Dataset.to_zarr
method with a compatible Hub array storage schema would be beneficial.
Issue Analytics
- State:
- Created 3 years ago
- Comments:7 (4 by maintainers)
Top Results From Across the Web
roadmap.rst.txt - Xarray
Xarray **integrates well** with other libraries in the scientific Python stack. ... Xarray currently supports wrapping multidimensional arrays defined by ...
Read more >Overview: Why xarray?
Xarray contributes domain-agnostic data-structures and tools for labeled multi-dimensional arrays to Python's SciPy ecosystem for numerical computing. In ...
Read more >Computation - Xarray
DataArray objects automatically align themselves (“broadcasting” in the numpy parlance) by dimension name instead of axis order. With xarray, you do not need...
Read more >Development roadmap - Xarray
Xarray integrates well with other libraries in the scientific Python stack. ... Xarray currently supports wrapping multidimensional arrays defined by NumPy, ...
Read more >Working with Multidimensional Coordinates - Xarray
Many datasets have physical coordinates which differ from their logical coordinates. Xarray provides several ways to plot and analyze such datasets. [1]:.
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Typically too big to fit into memory 😃 a good example is ERA5 climate reanalysis data, where the various climate variables are gridded by .25 x .25 lat lon with 24 hours of data and 37 pressure layers. Xarray’s
to_zarr
/from_zarr
enables nice appending methods and lazy loading of these types of arrays with the appropriate metadata. Leveraging Hub’s api would be great for these types of datasets.Closing this feature request due to inactivity and lack of interest. Will revive it if more users request it.