question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Adding the LBFGS optimizer from PyTorch

See original GitHub issue

Hi,

I am trying to use the BaggingRegressor model, with shallow estimators, on a small dataset, for which the LBFGS optimizer usually gives good results with a single estimator. However I see that the LBFGS optimizer in PyTorch is not included in the accepted list of optimizers for torchensemble. Will it be possible to add the LBFGS optimizer to the accepted list of optimizers, or is there any way that I can use the LBFGS optimizer with torchensemble for my work?

Thanks

Issue Analytics

  • State:open
  • Created 2 years ago
  • Comments:12 (8 by maintainers)

github_iconTop GitHub Comments

1reaction
xuyxucommented, Jun 13, 2021

Hi @e-eight, I am not sure if I understand your problem correctly. Perhaps you could open a pull request based on your current code, and we can then have a discussion there. For now, there is no need to pass all checks, simply upload your code, so that I can take a look and better understand your problem 😉

1reaction
xuyxucommented, Jun 10, 2021

@e-eight it would be better to open a PR on your own.

Read more comments on GitHub >

github_iconTop Results From Across the Web

LBFGS — PyTorch 1.13 documentation
Implements L-BFGS algorithm, heavily inspired by minFunc. ... This optimizer doesn't support per-parameter options and parameter groups (there can be only one).
Read more >
PyTorch-LBFGS: A PyTorch Implementation of L-BFGS - GitHub
Getting Started. To use the L-BFGS optimizer module, simply add /functions/LBFGS.py to your current path and use.
Read more >
Optimizing Neural Networks with LFBGS in PyTorch
The PyTorch documentation says. Some optimization algorithms such as Conjugate Gradient and LBFGS need to reevaluate the function multiple ...
Read more >
Fitting a model using torch.optim - BoTorch
The default optimizer for the SingleTaskGP is L-BFGS-B, which takes as input explicit bounds on the noise parameter. However, the torch optimizers don't...
Read more >
Improving LBFGS Optimizer in PyTorch: Knowledge Transfer ...
We have modified the LBFGS optimizer in PyTorch based on our knowledge in using the LBFGS algorithm in radio ... Date Added to...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found