[Bug] hydra.utils.to_absolute_path() does not work properly with the joblib launcher plugin
See original GitHub issue🐛 Bug
.to_absolute_path() works but not inside a multirun with the joblib launcher plugin
To reproduce
If main.py contains something like
hydra.utils.to_absolute_path('./some_file.txt')
This will work when running
python main.py foo=bar
but not
python main.py -m foo=bar
In the second case, the expanded version of some_file.txt
is not in the same directory as main.py
but is in the multirun output directory instead.
This problem only seems to occur when using the joblib launcher with
defaults:
- hydra/launcher: joblib
System information
- Hydra Version :
hydra-core==1.0.0rc1
andhydra-joblib-launcher==1.0.2
- Python version : 3.7.7
- Virtual environment type and version : Miniconda
- Operating system : Mac OS X
Issue Analytics
- State:
- Created 3 years ago
- Comments:5 (3 by maintainers)
Top Results From Across the Web
Joblib Launcher plugin - Hydra
The Joblib Launcher plugin provides a launcher for parallel tasks based on ... By default, process-based parallelism using all available CPU cores is...
Read more >hydra-joblib-launcher - PyPI
Joblib Launcher for Hydra apps. ... Released: May 17, 2022. Joblib Launcher for Hydra apps ... Parallel based Hydra Launcher supporting parallel execution....
Read more >Complete tutorial on how to use Hydra in Machine Learning ...
The main point is use orig_cwd = hydra.utils.get_original_cwd() to get the original working directory path and then you do not have to worry ......
Read more >Browse Python Technical Problem Clusters - Code Grepper
Get code examples instantly right from your google search results with the Grepper Chrome Extension.
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Hi @omry apologies for this. For some unknown reason I’m also currently unable to reproduce this bug. Thanks so much for looking into it and adding the test in any case.
Thanks, it’s not urgent as it seems the bug only applies to relative paths.