E.terminate called without an active exception when run test_spatial_narrow_as_op.py

PLEASE FOLLOW THESE INSTRUCTIONS BEFORE POSTING

1. Please thoroughly read README.md, INSTALL.md, GETTING_STARTED.md, and FAQ.md
2. Please search existing open and closed issues in case your issue has already been reported
3. Please try to debug the issue in case you can solve it on your own before posting

After following steps 1-3 above and agreeing to provide the detailed information requested below, you may continue with posting your issue

(Delete this line and the text above it.)

Expected results

https://github.com/facebookresearch/Detectron/blob/master/INSTALL.md python $DETECTRON/detectron/tests/test_spatial_narrow_as_op.py

run OK.

What did you expect to see? RUN OK.

Actual results

---

world@world-OMEN-X-by-HP-Laptop-17-ap0xx:~/Downloads$ world@world-OMEN-X-by-HP-Laptop-17-ap0xx:~/Downloads$ world@world-OMEN-X-by-HP-Laptop-17-ap0xx:~/Downloads$ python $DETECTRON/detectron/tests/test_spatial_narrow_as_op.py E0824 00:23:30.765760 17320 init_intrinsics_check.cc:43] CPU feature avx is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. E0824 00:23:30.765779 17320 init_intrinsics_check.cc:43] CPU feature avx2 is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. E0824 00:23:30.765781 17320 init_intrinsics_check.cc:43] CPU feature fma is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. Found Detectron ops lib: /home/world/miniconda3/lib/libcaffe2_detectron_ops_gpu.so E.terminate called without an active exception *** Aborted at 1535095411 (unix time) try “date -d @1535095411” if you are using GNU date *** PC: @ 0x7fc33db7b428 gsignal *** SIGABRT (@0x3e8000043a8) received by PID 17320 (TID 0x7fc33e332700) from PID 17320; stack trace: *** @ 0x7fc33df21390 (unknown) @ 0x7fc33db7b428 gsignal @ 0x7fc33db7d02a abort @ 0x7fc33578bb39 __gnu_cxx::__verbose_terminate_handler() @ 0x7fc33578a1fb __cxxabiv1::__terminate() @ 0x7fc33578a234 std::terminate() @ 0x7fc2e40bb430 caffe2::CUDAContext::~CUDAContext() @ 0x7fc2e40e81f2 caffe2::SpatialNarrowAsOp<>::~SpatialNarrowAsOp() @ 0x7fc334062995 caffe2::Workspace::RunOperatorOnce() @ 0x7fc334ff3ff8 ZZN6caffe26python16addGlobalMethodsERN8pybind116moduleEENKUlRKNS1_5bytesEE26_clES6.isra.3103.constprop.3163 @ 0x7fc334ff41a4 ZZN8pybind1112cpp_function10initializeIZN6caffe26python16addGlobalMethodsERNS_6moduleEEUlRKNS_5bytesEE26_bJS8_EJNS_4nameENS_5scopeENS_7siblingEEEEvOT_PFT0_DpT1_EDpRKT2_ENUlRNS_6detail13function_callEE1_4_FUNESQ @ 0x7fc3350278b0 pybind11::cpp_function::dispatcher() @ 0x5632fdf5b9e4 _PyCFunction_FastCallDict @ 0x5632fdfe8dfc call_function @ 0x5632fe00d94a _PyEval_EvalFrameDefault @ 0x5632fdfe2f8b fast_function @ 0x5632fdfe8ed5 call_function @ 0x5632fe00d94a _PyEval_EvalFrameDefault @ 0x5632fdfe2206 _PyEval_EvalCodeWithName @ 0x5632fdfe31cf fast_function @ 0x5632fdfe8ed5 call_function @ 0x5632fe00e715 _PyEval_EvalFrameDefault @ 0x5632fdfe2f8b fast_function @ 0x5632fdfe8ed5 call_function @ 0x5632fe00d94a _PyEval_EvalFrameDefault @ 0x5632fdfe2206 _PyEval_EvalCodeWithName @ 0x5632fdfe3897 _PyFunction_FastCallDict @ 0x5632fdf5bdaf _PyObject_FastCallDict @ 0x5632fdf60a73 _PyObject_Call_Prepend @ 0x5632fdf5b7ee PyObject_Call @ 0x5632fe00f10b _PyEval_EvalFrameDefault @ 0x5632fdfe2206 _PyEval_EvalCodeWithName Aborted (core dumped) What did you observe instead?

Detailed steps to reproduce

1. install tensor flow according to instruction— https://github.com/williamFalcon/tensorflow-gpu-install-ubuntu-16.04

2. install Detectron accroding to instruction: https://github.com/facebookresearch/Detectron/blob/master/INSTALL.md For caffe2: https://caffe2.ai/docs/getting-started.html?platform=ubuntu&configuration=prebuilt   #conda install -c caffe2 caffe2-cuda9.0-cudnn7

   python -c ‘from caffe2.python import core’ 2>/dev/null && echo “Success” || echo “Failure” output: success

   python2 -c ‘from caffe2.python import workspace; print(workspace.NumCudaDevices())’ output: 1

For COCOAPI: do exactly according to insturctions.

For: Detectron : do exactly according to insturctions. failed: python $DETECTRON/detectron/tests/test_spatial_narrow_as_op.py

The command that you ran python $DETECTRON/detectron/tests/test_spatial_narrow_as_op.py

System information

• Operating system: ubuntu16.04
• Compiler version: gcc (Ubuntu 5.4.0-6ubuntu1~16.04.10) 5.4.0 20160609
• CUDA version: ?CUDA Version 9.0.176
• cuDNN version: ? #define CUDNN_MAJOR 7 #define CUDNN_MINOR 1 #define CUDNN_PATCHLEVEL 1 – #define CUDNN_VERSION (CUDNN_MAJOR * 1000 + CUDNN_MINOR * 100 + CUDNN_PATCHLEVEL)

#include “driver_types.h”

• NVIDIA driver version: ?
• GPU models (for all devices if they are not all the same): ? GTX1080
• PYTHONPATH environment variable: ? not set.
• python --version output: ? Python 3.6.6 :: Anaconda, Inc.
• Anything else that seems relevant: ?

[wiwengweng]

I got this issue too. But docker version runs well and the test output is ‘ok’. You can try too.

also I found something that you should use python 2 instead of python 3.

I will try some other way to find out more info.

I see there’re some tests in the tests folder, then run the python test_zero_even_op.py test also get this error. So I try make ops and found that protobuf header is older. So, I think I shoud install caffe2 from source and use corresponding protobuf version.

updated on 3/9： build from source will solve this. Both tests and demo script will work fine then. I hope this helps.

root@bogon:~/Detectron/detectron/tests# python test_spatial_narrow_as_op.py 
E0831 15:43:12.620936 14113 init_intrinsics_check.cc:43] CPU feature avx is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU.
E0831 15:43:12.620975 14113 init_intrinsics_check.cc:43] CPU feature avx2 is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU.
E0831 15:43:12.620982 14113 init_intrinsics_check.cc:43] CPU feature fma is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU.
Found Detectron ops lib: /root/pytorch/build/lib/libcaffe2_detectron_ops_gpu.so
...
----------------------------------------------------------------------
Ran 3 tests in 2.396s

OK

[glc12125]

I got the same issue. If I ignore this test to try the following:

python2 tools/infer_simple.py
–cfg configs/12_2017_baselines/e2e_mask_rcnn_R-101-FPN_2x.yaml
–output-dir /tmp/detectron-visualizations
–image-ext jpg
–wts https://s3-us-west-2.amazonaws.com/detectron/35861858/12_2017_baselines/e2e_mask_rcnn_R-101-FPN_2x.yaml.02_32_51.SgT4y1cO/output/train/coco_2014_train:coco_2014_valminusminival/generalized_rcnn/model_final.pkl
demo

it detects no masks at all. Note that I did not build caffe2 from source but used the prebuilt binaries in Ubuntu 16.