question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Command line interpolations are not being evaluated lazily, leading to changed multirun behaviour

See original GitHub issue

In v0.11, when I wanted to do multirun with certain parameters dependent on each other, I would do something like

./train.py param1=1,2,3 param2=\${param1} -m

and this would launch 3 jobs, with same values for param1 and param2.

With v1.0, this seems to be launching 3*3 = 9 jobs, with all possible combinations of param1 and param2. Wondering if that’s expected behavior? My understanding was that the interpolations are evaluated lazily, so it should have the same behavior as in v0.11.

System information

  • Hydra Version : 1.0rc1
  • Python version : python 3.7.7
  • Virtual environment type and version : conda 4.7.10
  • Operating system : Linux

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:8 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
omrycommented, Jul 12, 2020

@egonuel thanks. the PR does not pass tests and is not ready. you are using it at your own risk 😃

I am not ready to push additional bugs onto this stack just yet. Please wait until I land what I am working on now and if there are still issues you can file new bugs.

1reaction
rohitgirdharcommented, Jun 27, 2020

Here is my actual usecase: basically I have been using this functionality to couple variables, for eg, if I am running a model on 5 folds, and I want to load a pre-trained model corresponding to the specific fold, I would do something like this:

./train.py fold_id=0,1,2,3,4 pretrained=/checkpoint/\${fold_id}
Read more comments on GitHub >

github_iconTop Results From Across the Web

valueerror raised while resolving interpolation: hydraconfig ...
It doesn't throw error if I set hydra.run.dir=${hydra:runtime.cwd}/logs so I see no reason for it not working with sweep dir; I wanted to...
Read more >
Eager interpolation with just a closure behaves like a lazy one?
But then, the containing interpolation is, by itself, not a closure, though it contains a closure. So then, why is it getting re-evaluated?...
Read more >
Misc/HISTORY - external/github.com/python/cpython
Issue #20710: The pydoc summary line no longer displays the "self" parameter. for bound methods. - Issue #20566: Change asyncio.as_completed() to use a ......
Read more >
Software Side-Channel Analysis - UCSB Computer Science
My research at UCSB could not have happened without collaborations with many hard-working, brilliant, and inspiring researchers. I am especially thankful to ...
Read more >
dbt Changelog - pyup.io
When set to `True`, allows prerelease packages to be installed. By default, this parameter is False unless explicitly set to True. Fixes -...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found