died with <Signals.SIGSEGV: 11>.

Thanks for your error report and we appreciate it a lot.

Checklist

1. I have searched related issues but cannot get the expected help.
2. The bug has not been fixed in the latest version.

Describe the bug A clear and concise description of what the bug is. I cloned the project in July and used it train a faster-rcnn model and now I wanna transfer this project to another machine which means the enviroment is different. I downloaded the latest project and copy the data and start to train but the error occurs and it didn’t show where the problem is. Plz help me with that. The enviroment difference is v100 -> p40 cuda 9.1 -> cuda9.0 torch1.1.0 ->torch1.1.0 no change python 3.7.3 -> 3.6.6

I run the “python setup.py develop” everytime I installed the new cloned project. but the error remains the same.

Reproduction

1. What command or script did you run?

tools/dist_train ...
A placeholder for the command.

1. Did you make any modifications on the code or config? Did you understand what you have modified?
2. What dataset did you use?

Environment

• OS: centos7
• PyTorch version 1.1.0 installed before
• GPU model p40
• CUDA and CUDNN version 9.0
• [optional] Other information that may be related (such as $PATH, $LD_LIBRARY_PATH, $PYTHONPATH, etc.)

Error traceback If applicable, paste the error trackback here.

2019-09-21 17:51:55,877 - INFO - workflow: [('train', 1)], max: 15 epochs
Traceback (most recent call last):
  File "/usr/local/python3/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/local/python3/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/local/python3/lib/python3.6/site-packages/torch/distributed/launch.py", line 235, in <module>
    main()
  File "/usr/local/python3/lib/python3.6/site-packages/torch/distributed/launch.py", line 231, in main
    cmd=process.args)
subprocess.CalledProcessError: Command '['/usr/bin/python', '-u', 'tools/train.py', '--local_rank=0', 'configs/pascal_voc/faster_rcnn_terrorism_cate13_badcase.py', '--launcher', 'pytorch', '--validate', '--work_dir', 'work_dirs/faster_rcnn_terrorism_cate13_badcase_0920']' died with <Signals.SIGSEGV: 11>.
A placeholder for trackback.

Bug fix If you have already identified the reason, you can provide the information here. If you are willing to create a PR to fix it, please also leave a comment here and that would be much appreciated!

[ZwwWayne]

Hi @qpfhuan , Signals.SIGSEGV: 11 seems to be a common bug when you are using different libraries/environments for compiling and running the code. I find a similar issue in other projects such as nvvl, this might give you a hint to check the running/compiling libraries to fix the bug.

[DeannaJ]

hi, have you fix this problem? I have no idea how to fix it. I have re-created a new virtual environment and that solved the problem.