Specify hyperparameter ranges for blocks
See original GitHub issueFeature Description
We want to enable the users to specify the value ranges for any argument in the blocks. The following code example shows a typical use case. The users can specify the number of units in a DenseBlock to be either 10 or 20.
Code Example
import autokeras as ak
from kerastuner.engine.hyperparameters import Choice
input_node = ak.ImageInput()
output_node = ak.DenseBlock(num_units=Choice("num_units", [10, 20]))(input_node)
output_node = ak.ClassificationHead()(output_node)
model = ak.AutoModel(input_node, output_node)
Note
Each pull request should only change one hyperparameter in one of the blocks.
Solution
Example pull requests are #1419 #1425 . Here are the steps to follow:
- You can just change any other argument in any other block supported by AutoKeras, as shown here.
- Change the docstring. example
- Make sure you imported the module.
from kerastuner.engine import hyperparameters
. - Change the typing of the argument. example
- Change the saving mechanism to serialized objects. example
- Change the loading mechanism to deserialized objects. example
- Change how we initialize the hyperparameter to self. example Copy from where it is originally defined. example
- Change how we use it. example
Issue Analytics
- State:
- Created 3 years ago
- Comments:18 (16 by maintainers)
Top Results From Across the Web
Define Hyperparameter Ranges - Amazon SageMaker
This guide shows how to use SageMaker APIs to define hyperparameter ranges. It also provides a list of hyperparameter scaling types that you...
Read more >HyperparameterTuner — sagemaker 2.122.0 documentation
Defines interaction with Amazon SageMaker hyperparameter tuning jobs. ... These parameter ranges can be one of three types: Continuous, Integer, ...
Read more >Overview of hyperparameter tuning | AI Platform Training
When you configure a training job with hyperparameter tuning, you define each hyperparameter to tune, its type, and the range of values to...
Read more >Ray Tune FAQ — Ray 2.2.0 - the Ray documentation
How do I choose hyperparameter ranges?# ... A good start is to look at the papers that introduced the algorithms, and also to...
Read more >Best Practices for Hyperparameter Tuning - Amazon SageMaker
The range of values for hyperparameters that you choose to search can significantly affect the success of hyperparameter optimization. Although you might want ......
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
@NickSmyr The PR is merged. Thanks for your contribution! AutoKeras will have another release soon before TF 2.9.0 stable release. Your commit will be in it.
@haifeng-jin yes, that was the last PR from our side.