Adding ExpertGate
See original GitHub issueI’m interested in adding ExpertGate to Avalanche. A few questions/thoughts I wanted to clarify before moving forward:
- While the original ExpertGate model uses a pretrained AlexNet, this limits the ExpertGate to whatever task PyTorch’s AlexNet was pretrained for (I think its vision tasks?). Should this implementation allow one to feed whichever model they’d like? Or, am I grossly misunderstanding something here?
- I imagine ExpertGate would be implemented as a
Model
? I can also view it as aStrategy
where you feed in your choice of model (see point above). Although, my gut says its should be aModel
.
Issue Analytics
- State:
- Created a year ago
- Comments:5 (2 by maintainers)
Top Results From Across the Web
Expert Gate: Lifelong Learning with a Network of Experts
Expert Gate : Lifelong Learning with a Network of Experts · Introduction · Requisites · Datasets and Designing the experiments · Training ·...
Read more >Expert Gate: Lifelong Learning with a Network of Experts - arXiv
In this paper we introduce a model of lifelong learning, based on a Network of Experts. New tasks / experts are learned and...
Read more >Expert Gate: Lifelong Learning With a Network of Experts
In this paper we introduce a model of lifelong learning, based on a Network of Experts. New tasks / experts are learned and...
Read more >Expert Gate: Lifelong Learning with a Network of Experts
Expert Gate [64] constructs a separate autoencoder for each task. ... Dynamic architectures add new parameters to the architecture of an ANN ...
Read more >THE EXPERT GATE COMPANY - 176 Photos & 32 Reviews
We had a smooth experience with the Expert Gate Company, installing a gate operator, adding a pedestrian gate and giving our existing metal…...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
I’m assigning this to you. Thanks for the help!
I agree. I would define a general component and leave AlexNet as the default. Keep in mind that we have the CL Baselines repo to host reproducible experiments.
You can check how we implement Progressive Neural Networks in Avalanche. Basically, we have a simple API to define dynamic modules that are expanded over time. Then, the ExpertGate strategy will be Naive strategy + an ExpertGate model.