Shared Memory client fails for batch size != 1

Requests with batch size 1 and correct input_byte_size calculation work correctly.

Increasing batch size to two and multiply input_byte_size by two leads to the following exception (modified version of simple_shm_client.cc):

int batch_size = 2;
options->SetBatchSize(batch_size);
size_t input_byte_size = 608 * 608 * 3 * sizeof(float) * batch_size;

failed setting shared memory input: [ 0] INVALID_ARG - The input ‘000_net’ has shared memory of size 8871936 bytes while the expected size is 4435968 bytes

So the expected size does not take batch size into account. Matching the expected size then fails during a different sanity check:

int batch_size = 2;
options->SetBatchSize(batch_size);
size_t input_byte_size = 608 * 608 * 3 * sizeof(float);

error: unable to run model: [inference:0 6] INVALID_ARG - unexpected shared-memory size 4435968 for input ‘000_net’, expecting 8871936 for model ‘yolov3’

So now batch size is taken into account for the expected byte size.

[CoderHam]

The fix to this is simple. I shall test it and create a new PR for it.

[philipp-schmidt]

Thanks, very much appreciated @CoderHam !