question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Customize learning_rate in autogluon classification .fit()

See original GitHub issue

I’m a student working on an autogluon project and can’t get the learning rate modified. I have an oscillating HPO chart and figured that was a good place to start.

sagemaker v2 train

Here’s my code:

import autogluon.core as ag
from autogluon import ImageClassification as task
from mxnet import optimizer as optim

dataset = task.Dataset('data/train')

@ag.obj(
        learning_rate=ag.space.Real(0.1111, 0.22222),
        momentum=ag.space.Real(0.86, 0.99),
        wd=ag.space.Real(1e-5, 1e-3, log=True)
        )        
class NAG(optim.NAG):
    pass
optimizer = NAG()

time_limit = 10*60
num_epochs = 30

classifier = task.fit(dataset, optimizer=optimizer, time_limits=time_limit, epochs=num_epochs, verbose=4)

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:5

github_iconTop GitHub Comments

1reaction
Innixmacommented, Feb 11, 2021

You probably aren’t using the pre-release then. I’d recommend creating a fresh venv without autogluon installed, and then following the pre-release install instructions.

0reactions
mhup115commented, Feb 11, 2021

I just tried updating to the pre-release, it says i’m running the latest version and to restart the kernel.

When following these docs on customizing the search space, the logs produced don’t reflect any of these changes. Pretty stumped unfortunately

Read more comments on GitHub >

github_iconTop Results From Across the Web

Customize learning_rate in autogluon classification .fit() #916
I'm a student working on an autogluon project and can't get the learning rate modified. I have an oscillating HPO chart and figured...
Read more >
Customize AutoMM — AutoGluon Documentation 0.5.3 ...
To use one uniform learning rate, simply set the learning rate multiple to 1 . # default used by AutoMM predictor.fit(hyperparameters= ...
Read more >
Customize AutoMM — AutoGluon Documentation 0.5.1 documentation
Learning rate. # default used by AutoMM predictor.fit(hyperparameters={"optimization.
Read more >
AutoGluon Predictors
Predictors built into AutoGluon such that a single call to fit() can produce high-quality trained models for tabular, image, or text data.
Read more >
autogluon.tabular.models
Perform hyperparameter tuning of the model, fitting multiple variants of the model based on the search space provided in hyperparameters during init. is_fit...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found