Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

trial._suggest supports GridSampler

See original GitHub issue

Motivation

Hi I am working on adding GridSampler to Hydra’s Optuna Sweeper. This is my PR in progress https://github.com/facebookresearch/hydra/pull/2132

I noticed that GridSampler seems to have different interfaces from the other Samplers. For example: trial._suggest does not work with a GridSampler.

I’m wondering if this could be supported? If not, is there any work around for this?

If not possible, we can still hard code some of the logic in the Sweeper to support this, but thought I’d ask the experts here to see if there’s a more elegant solution to this. Happy to provide more context if needed. Thanks in advance!

Description

See above

Alternatives (optional)

No response

Additional context (optional)

No response

Issue Analytics

State:
Created a year ago
Reactions:2
Comments:10 (3 by maintainers)

Top GitHub Comments

2reactions

nzw0301commented, Apr 7, 2022

FYI: issue on hydra repo https://github.com/facebookresearch/hydra/issues/1815

1reaction

toshihikoyanasecommented, Apr 13, 2022

Thank you for your kind ping. I’ll join the troubleshooting.

Top Results From Across the Web

Source code for optuna.samplers._grid

GridSampler `, the trials suggest all combinations of parameters in the given search space during the study. Example: .. testcode:: import optuna def ......

optuna/optuna - Gitter

Ask-and-Tell interface to construct trials without objective function callbacks. Heartbeat monitoring of trials to automatically fail stale trials. Constrained ...

Optuna: Simple Guide to Hyperparameters Tuning / Optimization

We'll be using methods of Trial instance for suggesting values of ... GridSampler - This is the same sampler as scikit-learn's grid search ......

arXiv:1907.10902v1 [cs.LG] 25 Jul 2019

Tune also supports parallel optimization, and uses the Ray ... layers.append(trial.suggest int('n units l {}'. format(i), 1, 128)).

Hyperparameter Optimization Techniques to Improve Your ...

Optimization methods (Samplers) ; GridSampler – It uses a grid search. The trials suggest all combinations of parameters in the given search ...