Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
How to chunk dask array with unknown chunks
See original GitHub issueHi All,
I have two dask arrays with shape X:(nan, 42), y:(nan,). I my goal is to fit these into a SGDRegressor dask-ml model. However, when I use it I am given an error saying that Cannot operate on Dask array with unknown chunk sizes. #453
Could anyone be able to tell me what should be done.
Thanks
Michael
Issue Analytics
- State:
- Created 5 years ago
- Comments:15 (10 by maintainers)
Top Results From Across the Web
Chunks - Dask documentation
Automatic chunking expands or contracts all dimensions marked with "auto" to try to reach chunk sizes with a number of bytes equal to...
Read more >Sample dask dataframe with unknown chunk sizes
I am trying to read a large .parquet as a dask dataframe and sample it: ddf ...
Read more >xarray.DataArray.chunk
Coerce this array's data into a dask arrays with the given chunks. If this variable is a non-dask array, it will be converted...
Read more >sidpy.sid.dataset. - GitHub Pages
Initializes Dataset object which is essentially a Dask array underneath ... any unknown chunks, the output has None for all the divisions (one...
Read more >Slicing a dask array with a dask dataframe in one compute
First off, dask Arrays just don't support using a dask DataFrame as the indexer. ... it as a dask Array with unknown chunksizes,...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
https://github.com/dask/dask/issues/4518
Answer in #4518