question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Add weights hyperparemeter to EnsembleForecaster API

See original GitHub issue

Is your feature request related to a problem? Please describe. EnsembleForecaster does not currently accept weights. With #1136 and #1139 being worked on it would be nice to optionally allow users to pass weights to EnsembleForecaster.

This would give users an out-of-the-box way to use ainverse error based weighting strategy in forecasting ensembles. Users could also supply other types of weights (information criterion, etc).

Describe the solution you’d like An update to the EnsembleForecaster API to allow weights to be passed (number weights should equal number of forecasters passed).

This would require altering the __init__ to store the weights, adding a check (in _fit?), and then updating _predict to use versions of the aggfunc that allow weights (for examples of this see use of _weighted_percentile, _weighted_geometric_mean, and np.average in performance_metrics_functions.py).

Describe alternatives you’ve considered N/A

Additional context N/A

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Reactions:3
  • Comments:6

github_iconTop GitHub Comments

1reaction
RNKuhnscommented, Jul 21, 2021

@GuzalBulatova that works for me. @aiwalter and I have been talking about some options for the functionality. Maybe the three of us can find a quick time to talk.

After digging into the online ensemblers per @fkiraly’s comment above. I think that the current differences between that and EnsembleForecaster are currently that the online ensemblers use weights and update those weights (the online part).

I think that it would be reasonable if the only difference was that the online ensembles update their weights (EnsembleForecaster would fix its weights based on the new weights hyperparameter).

1reaction
GuzalBulatovacommented, Jul 21, 2021

Hi @RNKuhns I’d like to work on this 🚀 It’s closely related to #1082 that I’m working on now.

Read more comments on GitHub >

github_iconTop Results From Across the Web

How to Develop a Weighted Average Ensemble With Python
A weighted average prediction involves first assigning a fixed weight coefficient to each ensemble member. This could be a floating-point ...
Read more >
1.11. Ensemble methods — scikit-learn 1.2.0 documentation
The goal of ensemble methods is to combine the predictions of several base estimators built with a given learning algorithm in order to...
Read more >
Optimizing Ensemble Weights and Hyperparameters ... - DeepAI
Aggregating multiple learners through an ensemble of models aims to make better predictions by capturing the underlying distribution more ...
Read more >
Hyperparameter tuning on numerai data with fastai and ...
However, as the results likely depend on many different hyperparameters, let's take advantage of the weights and biases library and their sweeps ...
Read more >
AutoGluon Predictors
Metric by which predictions will be ultimately evaluated on test data. AutoGluon tunes factors such as hyperparameters, early-stopping, ensemble-weights, etc.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found