Skorch + HyperbandSearchCV Example
See original GitHub issueCan you post a working example that uses Skorch and HyperbandSearchCV? I haven’t been able to find an actual working example.
The biggest challenge I’ve faced so far is how to determine the batch size being fed to the model. It’s unclear if that is the chunk size and beyond that, it’s unclear how Skorch’s batching interacts with that.
If I run search.fit(X, y)
with numpy arrays, the chunk size is massive and the grid search is very slow. If I try to chunk X, y in dask arrays, I get the following error:
ValueError: With n_samples=1, test_size=0.058823529411764705 and train_size=0.9411764705882353, the resulting train set will be empty. Adjust any of the aforementioned parameters.
Issue Analytics
- State:
- Created 3 years ago
- Comments:13 (7 by maintainers)
Top Results From Across the Web
Quickstart — skorch 0.12.1 documentation - Read the Docs
Training a model¶. Below, we define our own PyTorch Module and train it on a toy classification dataset using skorch NeuralNetClassifier :.
Read more >pytorch.rst.txt - Dask-ML
Skorch allows PyTorch models to be wrapped in Scikit-learn compatible estimators. ... For example, using Dask-ML's :class:`~dask_ml.model_selection.
Read more >Better and faster hyperparameter optimization with Dask
This section will highlight a using a model implemented with a popular deep learning library, and will will leverage Dask's parallelism and investigate...
Read more >Dask: From Scratch to Scalable Analytics in Python! - Medium
For example, using HyperbandSearchCV or Incremental with PyTorch from Dask-ML is possible after packaging with Skorch. Keras and Tensorflow. The SciKeras ...
Read more >Better and Faster Hyperparameter Optimization with Dask-ML
Typically used to define model structure. ... from dask_ml.model_selection import HyperbandSearchCV ... from skorch import NeuralNetRegressor model ...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Sure, let me see if I can clean up my example.
I’d be happy to clean up your example too. If you could make a PR, I could send in another PR to your branch.