Lightrun
question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

TensorRT Plugins failed during compiling

See original GitHub issue

Hello,

I am trying to convert text recognition from ONNX to TensorRT. I was able to compile the ONNX runtime and convert the pytorch model to the onnx. But I’m facing a problem with compiling TensorRT Plugins. I tried several time and follow all the steps that written in this document https://github.com/open-mmlab/mmcv/blob/master/docs/deployment/tensorrt_plugin.md and the other documentation but no success.

This is the error I get when i try this command MMCV_WITH_OPS=1 MMCV_WITH_TRT=1 pip install -e .

     command: /home/ /anaconda3/envs/mmlab/bin/python3.8 -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/ /Documents/Dev/mmcv/setup.py'"'"'; __file__='"'"'/home/ /Documents/Dev/mmcv/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps
         cwd: /home/ /Documents/Dev/mmcv/
    Complete output (461 lines):
    running develop
    running egg_info
    writing mmcv_full.egg-info/PKG-INFO
    writing dependency_links to mmcv_full.egg-info/dependency_links.txt
    writing requirements to mmcv_full.egg-info/requires.txt
    writing top-level names to mmcv_full.egg-info/top_level.txt
    reading manifest file 'mmcv_full.egg-info/SOURCES.txt'
    reading manifest template 'MANIFEST.in'
    adding license file 'LICENSE'
    adding license file 'LICENSES.md'
    writing manifest file 'mmcv_full.egg-info/SOURCES.txt'
    running build_ext
    building 'mmcv._ext_trt' extension
    creating build/temp.linux-x86_64-3.8/mmcv/ops/csrc/tensorrt
    creating build/temp.linux-x86_64-3.8/mmcv/ops/csrc/tensorrt/plugins
    /usr/local/cuda-11.4/bin/nvcc -DMMCV_WITH_CUDA -DMMCV_WITH_TRT -I/home/ /Documents/Dev/mmcv/mmcv/ops/csrc/common/cuda -I/home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt -I/home/ /Downloads/TensorRT-8.2.1.8/include -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include/TH -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda-11.4/include -I/home/ /anaconda3/envs/mmlab/include/python3.8 -c ./mmcv/ops/csrc/tensorrt/plugins/trt_nms_kernel.cu -o build/temp.linux-x86_64-3.8/./mmcv/ops/csrc/tensorrt/plugins/trt_nms_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE="_gcc" -DPYBIND11_STDLIB="_libstdcpp" -DPYBIND11_BUILD_ABI="_cxxabi1011" -DTORCH_EXTENSION_NAME=_ext_trt -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_86,code=compute_86 -gencode=arch=compute_86,code=sm_86 -std=c++14
    /usr/local/cuda-11.4/bin/nvcc -DMMCV_WITH_CUDA -DMMCV_WITH_TRT -I/home/ /Documents/Dev/mmcv/mmcv/ops/csrc/common/cuda -I/home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt -I/home/ /Downloads/TensorRT-8.2.1.8/include -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include/TH -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda-11.4/include -I/home/ /anaconda3/envs/mmlab/include/python3.8 -c ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align_kernel.cu -o build/temp.linux-x86_64-3.8/./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE="_gcc" -DPYBIND11_STDLIB="_libstdcpp" -DPYBIND11_BUILD_ABI="_cxxabi1011" -DTORCH_EXTENSION_NAME=_ext_trt -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_86,code=compute_86 -gencode=arch=compute_86,code=sm_86 -std=c++14
    /usr/local/cuda-11.4/bin/nvcc -DMMCV_WITH_CUDA -DMMCV_WITH_TRT -I/home/ /Documents/Dev/mmcv/mmcv/ops/csrc/common/cuda -I/home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt -I/home/ /Downloads/TensorRT-8.2.1.8/include -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include/TH -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda-11.4/include -I/home/ /anaconda3/envs/mmlab/include/python3.8 -c ./mmcv/ops/csrc/tensorrt/plugins/trt_corner_pool_kernel.cu -o build/temp.linux-x86_64-3.8/./mmcv/ops/csrc/tensorrt/plugins/trt_corner_pool_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE="_gcc" -DPYBIND11_STDLIB="_libstdcpp" -DPYBIND11_BUILD_ABI="_cxxabi1011" -DTORCH_EXTENSION_NAME=_ext_trt -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_86,code=compute_86 -gencode=arch=compute_86,code=sm_86 -std=c++14
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h: In member function ‘virtual bool nvinfer1::IGpuAllocator::deallocate(void*)’:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:1484:18: warning: ‘virtual void nvinfer1::IGpuAllocator::free(void*)’ is deprecated [-Wdeprecated-declarations]
     1484 |         this->free(memory);
          |                  ^
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:1415:29: note: declared here
     1415 |     TRT_DEPRECATED virtual void free(void* const memory) noexcept = 0;
          |                             ^~~~
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h: At global scope:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:6664:84: warning: ‘IRNNv2Layer’ is deprecated [-Wdeprecated-declarations]
     6664 |         ITensor& input, int32_t layerCount, int32_t hiddenSize, int32_t maxSeqLen, RNNOperation op) noexcept
          |                                                                                    ^~~~~~~~
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:3252:22: note: declared here
     3252 | class TRT_DEPRECATED IRNNv2Layer : public ILayer
          |                      ^~~~~~~~~~~
    gcc -pthread -B /home/ /anaconda3/envs/mmlab/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DMMCV_WITH_CUDA -DMMCV_WITH_TRT -I/home/ /Documents/Dev/mmcv/mmcv/ops/csrc/common/cuda -I/home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt -I/home/ /Downloads/TensorRT-8.2.1.8/include -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include/TH -I/home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda-11.4/include -I/home/ /anaconda3/envs/mmlab/include/python3.8 -c ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp -o build/temp.linux-x86_64-3.8/./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.o -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE="_gcc" -DPYBIND11_STDLIB="_libstdcpp" -DPYBIND11_BUILD_ABI="_cxxabi1011" -DTORCH_EXTENSION_NAME=_ext_trt -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
    cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h: In member function ‘virtual bool nvinfer1::IGpuAllocator::deallocate(void*)’:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:1484:26: warning: ‘virtual void nvinfer1::IGpuAllocator::free(void*)’ is deprecated [-Wdeprecated-declarations]
     1484 |         this->free(memory);
          |                          ^
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:1415:33: note: declared here
     1415 |     TRT_DEPRECATED virtual void free(void* const memory) noexcept = 0;
          |                                 ^~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h: At global scope:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:6664:101: warning: ‘IRNNv2Layer’ is deprecated [-Wdeprecated-declarations]
     6664 |         ITensor& input, int32_t layerCount, int32_t hiddenSize, int32_t maxSeqLen, RNNOperation op) noexcept
          |                                                                                                     ^~~~~~~~
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:3252:22: note: declared here
     3252 | class TRT_DEPRECATED IRNNv2Layer : public ILayer
          |                      ^~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:23:34: error: looser throw specifier for ‘virtual nvinfer1::IPluginV2DynamicExt* RoIAlignPluginDynamic::clone() const’
       23 |   nvinfer1::IPluginV2DynamicExt *clone() const override;
          |                                  ^~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:54,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntime.h:384:26: note: overridden function is ‘virtual nvinfer1::IPluginV2DynamicExt* nvinfer1::IPluginV2DynamicExt::clone() const noexcept’
      384 |     IPluginV2DynamicExt* clone() const noexcept override = 0;
          |                          ^~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:24:23: error: looser throw specifier for ‘virtual nvinfer1::DimsExprs RoIAlignPluginDynamic::getOutputDimensions(int, const nvinfer1::DimsExprs*, int, nvinfer1::IExprBuilder&)’
       24 |   nvinfer1::DimsExprs getOutputDimensions(
          |                       ^~~~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:54,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntime.h:410:23: note: overridden function is ‘virtual nvinfer1::DimsExprs nvinfer1::IPluginV2DynamicExt::getOutputDimensions(int32_t, const nvinfer1::DimsExprs*, int32_t, nvinfer1::IExprBuilder&) noexcept’
      410 |     virtual DimsExprs getOutputDimensions(
          |                       ^~~~~~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:27:8: error: looser throw specifier for ‘virtual bool RoIAlignPluginDynamic::supportsFormatCombination(int, const nvinfer1::PluginTensorDesc*, int, int)’
       27 |   bool supportsFormatCombination(int pos,
          |        ^~~~~~~~~~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:54,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntime.h:451:18: note: overridden function is ‘virtual bool nvinfer1::IPluginV2DynamicExt::supportsFormatCombination(int32_t, const nvinfer1::PluginTensorDesc*, int32_t, int32_t) noexcept’
      451 |     virtual bool supportsFormatCombination(
          |                  ^~~~~~~~~~~~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:30:8: error: looser throw specifier for ‘virtual void RoIAlignPluginDynamic::configurePlugin(const nvinfer1::DynamicPluginTensorDesc*, int, const nvinfer1::DynamicPluginTensorDesc*, int)’
       30 |   void configurePlugin(const nvinfer1::DynamicPluginTensorDesc *in,
          |        ^~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:54,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntime.h:493:18: note: overridden function is ‘virtual void nvinfer1::IPluginV2DynamicExt::configurePlugin(const nvinfer1::DynamicPluginTensorDesc*, int32_t, const nvinfer1::DynamicPluginTensorDesc*, int32_t) noexcept’
      493 |     virtual void configurePlugin(const DynamicPluginTensorDesc* in, int32_t nbInputs,
          |                  ^~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:34:10: error: looser throw specifier for ‘virtual size_t RoIAlignPluginDynamic::getWorkspaceSize(const nvinfer1::PluginTensorDesc*, int, const nvinfer1::PluginTensorDesc*, int) const’
       34 |   size_t getWorkspaceSize(const nvinfer1::PluginTensorDesc *inputs,
          |          ^~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:54,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntime.h:506:20: note: overridden function is ‘virtual size_t nvinfer1::IPluginV2DynamicExt::getWorkspaceSize(const nvinfer1::PluginTensorDesc*, int32_t, const nvinfer1::PluginTensorDesc*, int32_t) const noexcept’
      506 |     virtual size_t getWorkspaceSize(const PluginTensorDesc* inputs, int32_t nbInputs, const PluginTensorDesc* outputs,
          |                    ^~~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:38:7: error: looser throw specifier for ‘virtual int RoIAlignPluginDynamic::enqueue(const nvinfer1::PluginTensorDesc*, const nvinfer1::PluginTensorDesc*, const void* const*, void* const*, void*, cudaStream_t)’
       38 |   int enqueue(const nvinfer1::PluginTensorDesc *inputDesc,
          |       ^~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:54,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntime.h:522:21: note: overridden function is ‘virtual int32_t nvinfer1::IPluginV2DynamicExt::enqueue(const nvinfer1::PluginTensorDesc*, const nvinfer1::PluginTensorDesc*, const void* const*, void* const*, void*, cudaStream_t) noexcept’
      522 |     virtual int32_t enqueue(const PluginTensorDesc* inputDesc, const PluginTensorDesc* outputDesc,
          |                     ^~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:44:22: error: looser throw specifier for ‘virtual nvinfer1::DataType RoIAlignPluginDynamic::getOutputDataType(int, const nvinfer1::DataType*, int) const’
       44 |   nvinfer1::DataType getOutputDataType(int index,
          |                      ^~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:731:32: note: overridden function is ‘virtual nvinfer1::DataType nvinfer1::IPluginV2Ext::getOutputDataType(int32_t, const nvinfer1::DataType*, int32_t) const noexcept’
      731 |     virtual nvinfer1::DataType getOutputDataType(
          |                                ^~~~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:49:15: error: looser throw specifier for ‘virtual const char* RoIAlignPluginDynamic::getPluginType() const’
       49 |   const char *getPluginType() const override;
          |               ^~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:440:30: note: overridden function is ‘virtual const AsciiChar* nvinfer1::IPluginV2::getPluginType() const noexcept’
      440 |     virtual AsciiChar const* getPluginType() const noexcept = 0;
          |                              ^~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:50:15: error: looser throw specifier for ‘virtual const char* RoIAlignPluginDynamic::getPluginVersion() const’
       50 |   const char *getPluginVersion() const override;
          |               ^~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:454:30: note: overridden function is ‘virtual const AsciiChar* nvinfer1::IPluginV2::getPluginVersion() const noexcept’
      454 |     virtual AsciiChar const* getPluginVersion() const noexcept = 0;
          |                              ^~~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:51:7: error: looser throw specifier for ‘virtual int RoIAlignPluginDynamic::getNbOutputs() const’
       51 |   int getNbOutputs() const override;
          |       ^~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:469:21: note: overridden function is ‘virtual int32_t nvinfer1::IPluginV2::getNbOutputs() const noexcept’
      469 |     virtual int32_t getNbOutputs() const noexcept = 0;
          |                     ^~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:52:7: error: looser throw specifier for ‘virtual int RoIAlignPluginDynamic::initialize()’
       52 |   int initialize() override;
          |       ^~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:558:21: note: overridden function is ‘virtual int32_t nvinfer1::IPluginV2::initialize() noexcept’
      558 |     virtual int32_t initialize() noexcept = 0;
          |                     ^~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:53:8: error: looser throw specifier for ‘virtual void RoIAlignPluginDynamic::terminate()’
       53 |   void terminate() override;
          |        ^~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:572:18: note: overridden function is ‘virtual void nvinfer1::IPluginV2::terminate() noexcept’
      572 |     virtual void terminate() noexcept = 0;
          |                  ^~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:54:10: error: looser throw specifier for ‘virtual size_t RoIAlignPluginDynamic::getSerializationSize() const’
       54 |   size_t getSerializationSize() const override;
          |          ^~~~~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:620:20: note: overridden function is ‘virtual size_t nvinfer1::IPluginV2::getSerializationSize() const noexcept’
      620 |     virtual size_t getSerializationSize() const noexcept = 0;
          |                    ^~~~~~~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:55:8: error: looser throw specifier for ‘virtual void RoIAlignPluginDynamic::serialize(void*) const’
       55 |   void serialize(void *buffer) const override;
          |        ^~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:635:18: note: overridden function is ‘virtual void nvinfer1::IPluginV2::serialize(void*) const noexcept’
      635 |     virtual void serialize(void* buffer) const noexcept = 0;
          |                  ^~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:56:8: error: looser throw specifier for ‘virtual void RoIAlignPluginDynamic::destroy()’
       56 |   void destroy() override;
          |        ^~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:645:18: note: overridden function is ‘virtual void nvinfer1::IPluginV2::destroy() noexcept’
      645 |     virtual void destroy() noexcept = 0;
          |                  ^~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:57:8: error: looser throw specifier for ‘virtual void RoIAlignPluginDynamic::setPluginNamespace(const char*)’
       57 |   void setPluginNamespace(const char *pluginNamespace) override;
          |        ^~~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:677:18: note: overridden function is ‘virtual void nvinfer1::IPluginV2::setPluginNamespace(const AsciiChar*) noexcept’
      677 |     virtual void setPluginNamespace(AsciiChar const* pluginNamespace) noexcept = 0;
          |                  ^~~~~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:58:15: error: looser throw specifier for ‘virtual const char* RoIAlignPluginDynamic::getPluginNamespace() const’
       58 |   const char *getPluginNamespace() const override;
          |               ^~~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:687:30: note: overridden function is ‘virtual const AsciiChar* nvinfer1::IPluginV2::getPluginNamespace() const noexcept’
      687 |     virtual AsciiChar const* getPluginNamespace() const noexcept = 0;
          |                              ^~~~~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:11:7: error: ‘virtual bool nvinfer1::IPluginV2DynamicExt::canBroadcastInputAcrossBatch(int32_t) const’ is private within this context
       11 | class RoIAlignPluginDynamic : public nvinfer1::IPluginV2DynamicExt {
          |       ^~~~~~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:54,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntime.h:564:10: note: declared private here
      564 |     bool canBroadcastInputAcrossBatch(int32_t) const noexcept override final
          |          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:11:7: error: ‘virtual void nvinfer1::IPluginV2DynamicExt::configurePlugin(const Dims*, int32_t, const Dims*, int32_t, const nvinfer1::DataType*, const nvinfer1::DataType*, const bool*, const bool*, nvinfer1::PluginFormat, int32_t)’ is private within this context
       11 | class RoIAlignPluginDynamic : public nvinfer1::IPluginV2DynamicExt {
          |       ^~~~~~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:54,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntime.h:544:10: note: declared private here
      544 |     void configurePlugin(Dims const*, int32_t, Dims const*, int32_t, DataType const*, DataType const*, bool const*,
          |          ^~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:11:7: error: ‘virtual int32_t nvinfer1::IPluginV2DynamicExt::enqueue(int32_t, const void* const*, void* const*, void*, cudaStream_t)’ is private within this context
       11 | class RoIAlignPluginDynamic : public nvinfer1::IPluginV2DynamicExt {
          |       ^~~~~~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:54,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntime.h:574:13: note: declared private here
      574 |     int32_t enqueue(int32_t, const void* const*, void* const*, void*, cudaStream_t) noexcept override final
          |             ^~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:11:7: error: ‘virtual nvinfer1::Dims nvinfer1::IPluginV2DynamicExt::getOutputDimensions(int32_t, const Dims*, int32_t)’ is private within this context
       11 | class RoIAlignPluginDynamic : public nvinfer1::IPluginV2DynamicExt {
          |       ^~~~~~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:54,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntime.h:554:10: note: declared private here
      554 |     Dims getOutputDimensions(int32_t, Dims const*, int32_t) noexcept override final
          |          ^~~~~~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:11:7: error: ‘virtual size_t nvinfer1::IPluginV2DynamicExt::getWorkspaceSize(int32_t) const’ is private within this context
       11 | class RoIAlignPluginDynamic : public nvinfer1::IPluginV2DynamicExt {
          |       ^~~~~~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:54,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntime.h:569:12: note: declared private here
      569 |     size_t getWorkspaceSize(int32_t) const noexcept override final
          |            ^~~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:11:7: error: ‘virtual bool nvinfer1::IPluginV2DynamicExt::isOutputBroadcastAcrossBatch(int32_t, const bool*, int32_t) const’ is private within this context
       11 | class RoIAlignPluginDynamic : public nvinfer1::IPluginV2DynamicExt {
          |       ^~~~~~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:54,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntime.h:559:10: note: declared private here
      559 |     bool isOutputBroadcastAcrossBatch(int32_t, bool const*, int32_t) const noexcept override final
          |          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:11:7: error: ‘virtual bool nvinfer1::IPluginV2DynamicExt::supportsFormat(nvinfer1::DataType, nvinfer1::PluginFormat) const’ is private within this context
       11 | class RoIAlignPluginDynamic : public nvinfer1::IPluginV2DynamicExt {
          |       ^~~~~~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:54,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntime.h:549:10: note: declared private here
      549 |     bool supportsFormat(DataType, PluginFormat) const noexcept override final
          |          ^~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:86:15: error: looser throw specifier for ‘virtual const char* RoIAlignPluginDynamicCreator::getPluginName() const’
       86 |   const char *getPluginName() const override;
          |               ^~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:1134:30: note: overridden function is ‘virtual const AsciiChar* nvinfer1::IPluginCreator::getPluginName() const noexcept’
     1134 |     virtual AsciiChar const* getPluginName() const noexcept = 0;
          |                              ^~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:88:15: error: looser throw specifier for ‘virtual const char* RoIAlignPluginDynamicCreator::getPluginVersion() const’
       88 |   const char *getPluginVersion() const override;
          |               ^~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:1148:30: note: overridden function is ‘virtual const AsciiChar* nvinfer1::IPluginCreator::getPluginVersion() const noexcept’
     1148 |     virtual AsciiChar const* getPluginVersion() const noexcept = 0;
          |                              ^~~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:90:42: error: looser throw specifier for ‘virtual const nvinfer1::PluginFieldCollection* RoIAlignPluginDynamicCreator::getFieldNames()’
       90 |   const nvinfer1::PluginFieldCollection *getFieldNames() override;
          |                                          ^~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:1160:42: note: overridden function is ‘virtual const nvinfer1::PluginFieldCollection* nvinfer1::IPluginCreator::getFieldNames() noexcept’
     1160 |     virtual PluginFieldCollection const* getFieldNames() noexcept = 0;
          |                                          ^~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:92:24: error: looser throw specifier for ‘virtual nvinfer1::IPluginV2* RoIAlignPluginDynamicCreator::createPlugin(const char*, const nvinfer1::PluginFieldCollection*)’
       92 |   nvinfer1::IPluginV2 *createPlugin(
          |                        ^~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:1171:24: note: overridden function is ‘virtual nvinfer1::IPluginV2* nvinfer1::IPluginCreator::createPlugin(const AsciiChar*, const nvinfer1::PluginFieldCollection*) noexcept’
     1171 |     virtual IPluginV2* createPlugin(AsciiChar const* name, PluginFieldCollection const* fc) noexcept = 0;
          |                        ^~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:95:24: error: looser throw specifier for ‘virtual nvinfer1::IPluginV2* RoIAlignPluginDynamicCreator::deserializePlugin(const char*, const void*, size_t)’
       95 |   nvinfer1::IPluginV2 *deserializePlugin(const char *name,
          |                        ^~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:1182:24: note: overridden function is ‘virtual nvinfer1::IPluginV2* nvinfer1::IPluginCreator::deserializePlugin(const AsciiChar*, const void*, size_t) noexcept’
     1182 |     virtual IPluginV2* deserializePlugin(AsciiChar const* name, void const* serialData, size_t serialLength) noexcept
          |                        ^~~~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:99:8: error: looser throw specifier for ‘virtual void RoIAlignPluginDynamicCreator::setPluginNamespace(const char*)’
       99 |   void setPluginNamespace(const char *pluginNamespace) override;
          |        ^~~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:1197:18: note: overridden function is ‘virtual void nvinfer1::IPluginCreator::setPluginNamespace(const AsciiChar*) noexcept’
     1197 |     virtual void setPluginNamespace(AsciiChar const* pluginNamespace) noexcept = 0;
          |                  ^~~~~~~~~~~~~~~~~~
    In file included from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:101:15: error: looser throw specifier for ‘virtual const char* RoIAlignPluginDynamicCreator::getPluginNamespace() const’
      101 |   const char *getPluginNamespace() const override;
          |               ^~~~~~~~~~~~~~~~~~
    In file included from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferLegacyDims.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInfer.h:53,
                     from /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferPlugin.h:53,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_plugin_helper.hpp:5,
                     from /home/ /Documents/Dev/mmcv/mmcv/ops/csrc/tensorrt/trt_roi_align.hpp:9,
                     from ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:2:
    /home/ /Downloads/TensorRT-8.2.1.8/include/NvInferRuntimeCommon.h:1211:30: note: overridden function is ‘virtual const AsciiChar* nvinfer1::IPluginCreator::getPluginNamespace() const noexcept’
     1211 |     virtual AsciiChar const* getPluginNamespace() const noexcept = 0;
          |                              ^~~~~~~~~~~~~~~~~~
    ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp: In member function ‘virtual int RoIAlignPluginDynamic::enqueue(const nvinfer1::PluginTensorDesc*, const nvinfer1::PluginTensorDesc*, const void* const*, void* const*, void*, cudaStream_t)’:
    ./mmcv/ops/csrc/tensorrt/plugins/trt_roi_align.cpp:125:27: warning: pointer of type ‘void *’ used in arithmetic [-Wpointer-arith]
      125 |       argmax_x = argmax_y + output_size * word_size;
          |                  ~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~
    /home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/setuptools/installer.py:27: SetuptoolsDeprecationWarning: setuptools.installer is deprecated. Requirements should be satisfied by a PEP 517 installer.
      warnings.warn(
    /home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/setuptools/command/easy_install.py:156: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.
      warnings.warn(
    /home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
      warnings.warn(
    /home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/torch/utils/cpp_extension.py:370: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
      warnings.warn(msg.format('we could not find ninja.'))
    error: command 'gcc' failed with exit status 1
    ----------------------------------------
  Rolling back uninstall of mmcv-full
  Moving to /home/ /anaconda3/envs/mmlab/lib/python3.8/site-packages/mmcv-full.egg-link
   from /tmp/pip-uninstall-ncp_gm3j/mmcv-full.egg-link
ERROR: Command errored out with exit status 1: /home/ /anaconda3/envs/mmlab/bin/python3.8 -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/ /Documents/Dev/mmcv/setup.py'"'"'; __file__='"'"'/home/ /Documents/Dev/mmcv/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps Check the logs for full command output.

I tried to compile the new version of tensortrt 8.2.1.8 instead of tensorrt version 7 since I have linux 20.

OS: Ubuntu 20.04.3 LTS GPU: RTX 3090 CUDA: 11.3 Pytorch: 1.10

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:9 (5 by maintainers)

github_iconTop GitHub Comments

3reactions
grimoirecommented, Dec 2, 2021

@twmht Thank you! Actually, we are doing some refactor about model export. Update TensorRT version is one of them. I believe it will be finished soon. You are welcome to contribute after that.

1reaction
grimoirecommented, Jan 19, 2022

@SebastienLinker yes, and codes about the model deployment in other repo will also be moved to MMDeploy.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Error installing x86 TensorRT OSS Plugin - DeepStream SDK
I follow this guide to install the x86 TensorRT OSS Plugin but I got the following error: $HOME/install/bin/cmake .
Read more >
How to Convert Your Custom Model into TensorRT
In this blog, we'll show you how to convert your model with custom operators into TensorRT and how to avoid these errors! Nvidia...
Read more >
onnx to trt failed - RuntimeError: cannot get YoloLayer_TRT ...
It seems that YoloLayer_TRT is custom plugin built by yolo team, and you have to load library file to use it in python....
Read more >
Object Detection at 2530 FPS with TensorRT and 8-Bit ...
Masking in Pytorch will result in NonZero ONNX nodes which cannot be expressed as a TensorRT layer or plugin. TensorRT fails with No ......
Read more >
TensorRT Plugin Autogen Tool - by Tencent @ TVMCon 2021
SPEAKER: Qian Qiu--The work of writing a TensorRT plugin requires solid CUDA programming skills and considerable time to make the plugin ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found
Previous page

mmcv.Registry unexpected resulets

Next page

Failed building wheel for opencv-python with error message - No such file or directory: 'scripts/__init__.py'