Issue with releasing Neural Compute Stick 2 (MYRIAD) resources programmatically while using async_pipeline.h

Environment: OpenVINO 2021.2.185 Device: Neural Compute Stick 2 I’m trying to create an application in C++ using the async pipeline-based code followed in object_detection_demo.exe. I’m facing an issue where the NCS2 resource is not being released correctly which results in Can not init Myriad device: NC_ERROR when I try to use NCS2 in the same process but for a different model configuration. I’m following the same steps as used in the object_detection_demo.exe. I’ve also tried setting the MYRIAD_ENABLE_FORCE_RESET to “YES”, but that doesn’t work either. Ways to reproduce the error:

1. Run object_detection_demo.exe with NCS2 in quick succession.
2. Run segmentation_demo_async.exe with NCS2 in quick succession.

Both of these examples use the async_pipeline based code. Here is a reference to the Intel Community forum post which contains a detailed explanation for this error and a potential bug in the pipeline/requests pool codebase. Attaching logs of object_detection_demo.exe when run in quick succession. logs.txt Ref for the issue: @vladimir-dudnik.

[saifvazir]

Hey @vladimir-dudnik, sorry for not being responsive earlier, I tried cherry-picking the commit onto 2021.2 and 2021.3 releases and then build the object detection demo. The build goes through successfully but the demo fails. I was not aware about the incompatible API changes. I will try building openvino from the develop branch and check if the demo works then or not.

[vladimir-dudnik]

@saifvazir We’ve created PR https://github.com/openvinotoolkit/open_model_zoo/pull/2375 to work on solution