it will execute multiple times when import from test.py

In my commamd line, the ‘test.py’ works well .

I want use this file in other python file, So I add a function to ‘test.py’, it is:

    def run(self, imgs=None, model="config/ade20k-resnet50dilated-ppm_deepsup.yaml", gpu=0):
        if imgs == None:
            return False
        cfg.merge_from_file(model)

        cfg.MODEL.arch_encoder = cfg.MODEL.arch_encoder.lower()
        cfg.MODEL.arch_decoder = cfg.MODEL.arch_decoder.lower()

        # absolute paths of model weights
        cfg.MODEL.weights_encoder = os.path.join(
            cfg.DIR, 'encoder' + cfg.TEST.suffix)
        cfg.MODEL.weights_decoder = os.path.join(
            cfg.DIR, 'decoder' + cfg.TEST.suffix)

        if not os.path.exists(cfg.MODEL.weights_encoder):
            return  (False, "checkpoint does not exitst!")

        # generate testing image list
        if os.path.isdir(imgs[0]):
            imgs = find_recursive(imgs[0])
        else:
            imgs = [imgs]
        assert len(imgs), "imgs should be a path to image (.jpg) or directory."
        cfg.list_test = [{'fpath_img': x} for x in imgs]
        if not os.path.isdir(cfg.TEST.result):
            os.makedirs(cfg.TEST.result)
        
        main(cfg, gpu)

However, In another file, when I use this function like this:

import run from test
run("test.jpg")

It outputs error:

Loading weights for net_encoder
Loading weights for net_decoder
# samples: 1
Loading weights for net_encoder
Loading weights for net_encoder
Loading weights for net_encoder
Loading weights for net_encoder
Loading weights for net_encoder
Loading weights for net_decoder
Loading weights for net_decoder
Loading weights for net_decoder
# samples: 1
Loading weights for net_decoder
Loading weights for net_decoder
# samples: 1
# samples: 1
# samples: 1
......

then my command line is crash.

However, to use this function in the file test.py works well. Only in other file will it failed.

This function is as same as the code in the if __name__ == '__main__':, so where is wrong?

Thanks.

[acdzh]

I finally find why: I try to print the __name__ in the begin of the function run(). At first it print __main__, after that it print many __mp_main__. It is the module multiprocess 's problem and only occurs on Windows.

Those too many new processes is the reason why my cammand line crash.

Solution: in other file, please judge if __name__ == '__main__': every time, like this:

import run from test
if __name__ == '__main__':
    run('img/test.jpg')

This problem just occurs on Windows.

For more can see multiprocess , torch.multiprocessing

[hangzhaomit]

@acdzh maybe I have a bug here, can you try to replace imgs[0] with imgs?