[Bug] %run magic with jupyter notebook

🐛 Bug

Expect to run hydra in a notebook cell and get realtime output like in Terminal.

Two ways of running a python file in Jupyter !python (calling the terminal directly) -> but cannot get real time output %run (Jupyter way of running python file, but does not seems compatible with Hydra directly)

I am expecting this can run %run runner.py exp_name=abc

To reproduce

hydra_tqdm_notebook.py

import hydra
@hydra.main(config_path="configs/config.yaml")
def experiment_runner(cfg) -> None:
    from tqdm import tqdm_notebook as tqdm


    for i in tqdm(range(5)):
        import time
        time.sleep(0.02)
        print('helloworld')

if __name__ == "__main__":
    experiment_runner()

** Stack trace/error message **

Expected Behavior

The only difference between test_hydra_tqdm_notebook.py and test_tqdm_notebook.py is I wrapped it inside the Hydra runner. I expect the output to be the same.

System information

• Hydra Version :
• Python version :
• Virtual environment type and version :
• Operating system :

Additional context

test_tqdm_notebook.py

from tqdm import tqdm_notebook as tqdm
for i in tqdm(range(100)):
    import time
    time.sleep(0.02)
    print('helloworld')

[omry]

Your example is a bit convoluted. can you try to minimize it a bit? I am not sure I understand the role of each of the 3 files.

[omry]

Hi, It also happened in The Jupyter Lab Terminal:

I have a fix coming for this issue (%run). If this does not solve the other problem file a different issue and explain how to reproduce. I have never used Jupyter Lab Terminal.