[Question] WandB logging with SubprocVecEnv

Question

Is it possible to perform logging using the WandB callback while using the SubprocVecEnv? I tried but I am encountering errors, so I’d like to know if you already tried this.

Additional context

If I create a run for each different environment in a subprocess (basically call wand.init inside the env), I get the following error AssertionError: daemonic processes are not allowed to have children

However, if I create one single run and perform the logging in the subprocesses, I get a different error (basically the PID of the process initializing the run and the PID of the processes performing the logs are different)

Checklist

• I have read the documentation (required)
• I have checked that there is no similar issue in the repo (required)

[araffin]

I should call init in each subprocess, right?

I don’t think so, callback is in the main thread, not in the subprocesses. Closing as the issue is related to W&B, not SB3, and as the W&B works fine in the RL Zoo with multiple envs (and with subprocesses). See for instance https://wandb.ai/openrlbenchmark/sb3/runs/2tf89ihi?workspace=user-araffin

[tfederico]

From what I understood from the WandB documentation, it is one of the 2 options for multiprocessing (call initin all your processes).

So if I use SubprocVecEnv and create a subprocess for each env, I should call init in each subprocess, right?