Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Skorch + HyperbandSearchCV Example

See original GitHub issue

Can you post a working example that uses Skorch and HyperbandSearchCV? I haven’t been able to find an actual working example.

The biggest challenge I’ve faced so far is how to determine the batch size being fed to the model. It’s unclear if that is the chunk size and beyond that, it’s unclear how Skorch’s batching interacts with that.

If I run search.fit(X, y) with numpy arrays, the chunk size is massive and the grid search is very slow. If I try to chunk X, y in dask arrays, I get the following error: ValueError: With n_samples=1, test_size=0.058823529411764705 and train_size=0.9411764705882353, the resulting train set will be empty. Adjust any of the aforementioned parameters.

Issue Analytics

State:
Created 3 years ago
Comments:13 (7 by maintainers)

Top GitHub Comments

1reaction

ToddMorrillcommented, May 14, 2020

Sure, let me see if I can clean up my example.

0reactions

stsievertcommented, May 17, 2020

Sure, let me see if I can clean up my example.

I’d be happy to clean up your example too. If you could make a PR, I could send in another PR to your branch.

Top Results From Across the Web

Quickstart — skorch 0.12.1 documentation - Read the Docs

Training a model¶. Below, we define our own PyTorch Module and train it on a toy classification dataset using skorch NeuralNetClassifier :.

pytorch.rst.txt - Dask-ML

Skorch allows PyTorch models to be wrapped in Scikit-learn compatible estimators. ... For example, using Dask-ML's :class:`~dask_ml.model_selection.

Better and faster hyperparameter optimization with Dask

This section will highlight a using a model implemented with a popular deep learning library, and will will leverage Dask's parallelism and investigate...

Dask: From Scratch to Scalable Analytics in Python! - Medium

For example, using HyperbandSearchCV or Incremental with PyTorch from Dask-ML is possible after packaging with Skorch. Keras and Tensorflow. The SciKeras ...

Better and Faster Hyperparameter Optimization with Dask-ML

Typically used to define model structure. ... from dask_ml.model_selection import HyperbandSearchCV ... from skorch import NeuralNetRegressor model ...