Adding the LBFGS optimizer from PyTorch
See original GitHub issueHi,
I am trying to use the BaggingRegressor
model, with shallow estimators, on a small dataset, for which the LBFGS optimizer usually gives good results with a single estimator. However I see that the LBFGS optimizer in PyTorch is not included in the accepted list of optimizers for torchensemble
. Will it be possible to add the LBFGS optimizer to the accepted list of optimizers, or is there any way that I can use the LBFGS optimizer with torchensemble
for my work?
Thanks
Issue Analytics
- State:
- Created 2 years ago
- Comments:12 (8 by maintainers)
Top Results From Across the Web
LBFGS — PyTorch 1.13 documentation
Implements L-BFGS algorithm, heavily inspired by minFunc. ... This optimizer doesn't support per-parameter options and parameter groups (there can be only one).
Read more >PyTorch-LBFGS: A PyTorch Implementation of L-BFGS - GitHub
Getting Started. To use the L-BFGS optimizer module, simply add /functions/LBFGS.py to your current path and use.
Read more >Optimizing Neural Networks with LFBGS in PyTorch
The PyTorch documentation says. Some optimization algorithms such as Conjugate Gradient and LBFGS need to reevaluate the function multiple ...
Read more >Fitting a model using torch.optim - BoTorch
The default optimizer for the SingleTaskGP is L-BFGS-B, which takes as input explicit bounds on the noise parameter. However, the torch optimizers don't...
Read more >Improving LBFGS Optimizer in PyTorch: Knowledge Transfer ...
We have modified the LBFGS optimizer in PyTorch based on our knowledge in using the LBFGS algorithm in radio ... Date Added to...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Hi @e-eight, I am not sure if I understand your problem correctly. Perhaps you could open a pull request based on your current code, and we can then have a discussion there. For now, there is no need to pass all checks, simply upload your code, so that I can take a look and better understand your problem 😉
@e-eight it would be better to open a PR on your own.