question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[FEATURE] xarray integration + support for multidimensional arrays

See original GitHub issue

🚨🚨 Feature Request

  • Related to an existing Issue
  • A new implementation (Improvement, Extension)

Add support for multidimensional arrays. A typical usage pattern is weather or climate data where the variables are feature arrays by latitude, longitude, time, and pressure level. Building on xarray’s Dataset.to_zarr method with a compatible Hub array storage schema would be beneficial.

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:7 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
stanbiryukovcommented, Feb 18, 2021

Typically too big to fit into memory 😃 a good example is ERA5 climate reanalysis data, where the various climate variables are gridded by .25 x .25 lat lon with 24 hours of data and 37 pressure layers. Xarray’s to_zarr/from_zarr enables nice appending methods and lazy loading of these types of arrays with the appropriate metadata. Leveraging Hub’s api would be great for these types of datasets.

0reactions
mynameisvinncommented, Mar 4, 2021

Closing this feature request due to inactivity and lack of interest. Will revive it if more users request it.

Read more comments on GitHub >

github_iconTop Results From Across the Web

roadmap.rst.txt - Xarray
Xarray **integrates well** with other libraries in the scientific Python stack. ... Xarray currently supports wrapping multidimensional arrays defined by ...
Read more >
Overview: Why xarray?
Xarray contributes domain-agnostic data-structures and tools for labeled multi-dimensional arrays to Python's SciPy ecosystem for numerical computing. In ...
Read more >
Computation - Xarray
DataArray objects automatically align themselves (“broadcasting” in the numpy parlance) by dimension name instead of axis order. With xarray, you do not need...
Read more >
Development roadmap - Xarray
Xarray integrates well with other libraries in the scientific Python stack. ... Xarray currently supports wrapping multidimensional arrays defined by NumPy, ...
Read more >
Working with Multidimensional Coordinates - Xarray
Many datasets have physical coordinates which differ from their logical coordinates. Xarray provides several ways to plot and analyze such datasets. [1]:.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found