[Question] Override default hydra configuration

For organizing experiments (using the example from the doc), we could override the defaults values in file experiment/nglite.yaml with

# @package _global_
defaults:
  - override /db: sqlite
  - override /server: nginx
  
server:
  port: 8080

Is it possible to override the hydra config within the same file? I tried

# @package _global_
defaults:
  - override /hydra: some_config

but would result an error Could not override 'hydra'. Did you mean to override hydra?.

[ZachariahPang]

Hi @jieru-hu @Jasha10, Sorry I didn’t explain my question well. I’m using Hydra 1.1.0.rc1.

What I’m trying to do is having a single file containing all the configs related to a certain experiment (some specific model, trainer, logger, etc) in configs/experiment/experiment1.yaml. Normally all the logs are in logs/runs/some_date/some_time as normal, but when I run some experiments, the logs would be changed to another dir experiment/experiment_name/version.

My minimum config files looks as follow

• configs
  • model
    • model1.yaml
    • model2.yaml
  • experiment
    • experiment1.yaml
    • experiment2.yaml
  • hydra
    • default.yaml
    • experiment.yaml
  • config.yaml

Inside configs/config.yaml, there is already a default hydra configuration

defaults:
  - model: model1
  - experiment: null
  - hydra: default

configs/hydra/default.yaml has

run:
    dir: logs/runs/${now:%Y-%m-%d}/${now:%H-%M-%S}

configs/hydra/experiment.yaml has

run:
    dir: experiment/${experiment_name}/${version}

configs/experiment/experiment1.yaml has

defaults:
    - override /model: model1
    - override /hydra: experiment

experiment_name: some_exp
version: v1

The desired behavior is to run with flag python main.py experiment=experiment1 and then the logs would automatically be inside experiment/some_exp/v1 instead of the default log dir. I’m not sure if this is the right approach.

[omry]

Closing, feel free to reopen and provide the requested info.