ERROR train.py: Default process group is not initialized

I get this error when training on a single GPU, when calling the function distributed() to disable tqdm.

To avoid this I have simple wrapped distributed like:

def distributed():
    try:
        return dist.is_available() and dist.is_initialized()
    except:
        return False

[loretoparisi]

@jongwook yes I can make it working with the changes I did so far. I will further investigate NCLL by the way. Thanks.

[jongwook]

Can you paste the output of the following bash script - to check your system information?

curl https://raw.githubusercontent.com/pytorch/pytorch/master/torch/utils/collect_env.py | python -

I suspect two possibilities:

• Your NCCL installation is incomplete: try this to (re)install it
• You’re on Windows: we don’t have plan for Windows support it at this point.