Adding ExpertGate

I’m interested in adding ExpertGate to Avalanche. A few questions/thoughts I wanted to clarify before moving forward:

• While the original ExpertGate model uses a pretrained AlexNet, this limits the ExpertGate to whatever task PyTorch’s AlexNet was pretrained for (I think its vision tasks?). Should this implementation allow one to feed whichever model they’d like? Or, am I grossly misunderstanding something here?
• I imagine ExpertGate would be implemented as a Model? I can also view it as a Strategy where you feed in your choice of model (see point above). Although, my gut says its should be a Model.

[AntonioCarta]

I’m assigning this to you. Thanks for the help!

[AntonioCarta]

1. I agree. I would define a general component and leave AlexNet as the default. Keep in mind that we have the CL Baselines repo to host reproducible experiments.

2. You can check how we implement Progressive Neural Networks in Avalanche. Basically, we have a simple API to define dynamic modules that are expanded over time. Then, the ExpertGate strategy will be Naive strategy + an ExpertGate model.