referencing files without defaults, dealing with list of files

Hi,

Let’s say I have the following config directory.

trainer/
 | optim/
    |  sgd.yaml
    |  adam.yaml
          ....
 | models/
     |  unet.yaml
     |  restnet.yaml
          ....
 trainer_config.yaml

I would like to compose my trainer_config.yaml as follows:

optim: 
 - sgd
 - adam
models:
 - unet
 - resnet

I encounter two problems doing this:

1. I see that hydra doesn’t let me instantiate paths to files if keys are not listed under defaults. Is there a way to compose configurations from multiple files without using defaults (the way I mentioned above)?

2. Say to counter this problem I use defaults, then I would like my config to look like:

defaults:
  optim:
   - sgd
   - adam
  models:
   - unet
   - resnet

since my model contains two sub-models or it uses multiple optimizers. It seems that defaults does not recognize a list of config files. What is the correct way to configure such a system? Am I missing something?

Thanks!

[omry]

@sankethvedula, this link is a part of the basic tutorial. I strongly suggest that you read the entire thing 😃

Closing, feel free to continue this on the chat.

[sankethvedula]

Hi Omry. thanks for the response. The link you’ve sent is helpful, I’ll try to continue this discussion on the Zulip channel – probably that’s a better place to discuss this 😃