Customize learning_rate in autogluon classification .fit()
See original GitHub issueI’m a student working on an autogluon project and can’t get the learning rate modified. I have an oscillating HPO chart and figured that was a good place to start.
Here’s my code:
import autogluon.core as ag
from autogluon import ImageClassification as task
from mxnet import optimizer as optim
dataset = task.Dataset('data/train')
@ag.obj(
learning_rate=ag.space.Real(0.1111, 0.22222),
momentum=ag.space.Real(0.86, 0.99),
wd=ag.space.Real(1e-5, 1e-3, log=True)
)
class NAG(optim.NAG):
pass
optimizer = NAG()
time_limit = 10*60
num_epochs = 30
classifier = task.fit(dataset, optimizer=optimizer, time_limits=time_limit, epochs=num_epochs, verbose=4)
Issue Analytics
- State:
- Created 3 years ago
- Comments:5
Top Results From Across the Web
Customize learning_rate in autogluon classification .fit() #916
I'm a student working on an autogluon project and can't get the learning rate modified. I have an oscillating HPO chart and figured...
Read more >Customize AutoMM — AutoGluon Documentation 0.5.3 ...
To use one uniform learning rate, simply set the learning rate multiple to 1 . # default used by AutoMM predictor.fit(hyperparameters= ...
Read more >Customize AutoMM — AutoGluon Documentation 0.5.1 documentation
Learning rate. # default used by AutoMM predictor.fit(hyperparameters={"optimization.
Read more >AutoGluon Predictors
Predictors built into AutoGluon such that a single call to fit() can produce high-quality trained models for tabular, image, or text data.
Read more >autogluon.tabular.models
Perform hyperparameter tuning of the model, fitting multiple variants of the model based on the search space provided in hyperparameters during init. is_fit...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
You probably aren’t using the pre-release then. I’d recommend creating a fresh venv without autogluon installed, and then following the pre-release install instructions.
I just tried updating to the pre-release, it says i’m running the latest version and to restart the kernel.
When following these docs on customizing the search space, the logs produced don’t reflect any of these changes. Pretty stumped unfortunately