Deriving an experiment name from a given config

Hello, I am not sure if this is a trivial question. I want to change an experiment’s name depending on the used configuration. The reason is to have a clear overview over multiple experiments with different configurations in visualization tools like omniboard. Because I use seml to run my sacred experiments within a slurm system, I have no control over executing the experiment.run() function.

I tried to set _run.experiment_info["name"] = "my_new_name" in the main and a pre_run_hook function, but the change did not persist to the MongoDB.

After reading issue 110 (basically the reverse of what I want to do), I tried the mentioned option_hook. Using this, I can successfully change the experiment’s name and it persists to the MongoDB. However, in the option hook I don’t have access to my configuration and hence, I can’t update the name in the way I want to.

Is this use case currently supported and if, how could I accomplish a configuration dependent name change?

[thequilo]

I don’t know how seml works, does it pass the yaml file by ex.add_config(yaml_file) or by calling the sacred script with with config.yaml? It should be possible to define a config scope:

ex = Experiment('default_name')

@ex.config
def config(): 
    some_config_value = None   # Will be set form your yaml file when called with `with config.yaml`
    ex.path = f'derived_name_{some_config_value}'

[thequilo]

Glad that it worked! I’ll close the issue for now