local s3 storage

Description I have a local s3 running and I want to set --model-store to the s3 bucket. However, I am not able to pass the credentials for my local s3.

TRTIS Information What version of TRTIS are you using? nvcr.io/nvidia/tensorrtserver:19.12-py3 Are you using the TRTIS container or did you build it yourself? I am using the TRTIS container

To Reproduce Steps to reproduce the behavior:

1. Create the aws config folder

.aws/
   config
   credentials

config:

[default]
s3 =
    endpoint_url=http://minio:9000
    signature_version = s3v4

[plugins]
endpoint = awscli_plugin_endpoint

credentials:

[default]
aws_access_key_id='foo'
aws_secret_access_key='bar'

1. Create new image from TRTIS container by adding awscli_plugin_endpoint and .aws to the container. Dockerfile:

FROM nvcr.io/nvidia/tensorrtserver:19.12-py3

RUN pip3 install awscli_plugin_endpoint
COPY .aws /root/.aws

1. build trtis image from `Dockerfile
2. run server

docker run --rm trtis trtserver --model-store=s3://models

When I run TRTIS I get the following error:

E0113 20:41:25.707104 1 main.cc:1158] error: creating server: INTERNAL - Could not get MetaData for bucket with name models

Expected behavior I expected it to use credentials and endpoint provided in the .aws folder and connect to my s3 bucket. What would be the proper way of using the local s3 storage? How to provide access key, secret and endpoints?

[CoderHam]

To be fixed with #1059, will close when merged into master

[bezero]

@deadeyegoodwin You are running your own S3-compatible server? Yes, I am running local S3 using MinIO More details: in filesystem.cc file inside S3FileSystem::S3FileSystem where s3client is created we can add the endpoint url. If I am not wrong, it would look something like:

Aws::Client::ClientConfiguration config("default");
config.endpointOverride = "localhost:<minio-port>";
client_ = s3::S3Client(config);

I think if it works, than endpointOverride can be added as an option and used as: trtserver --endpointOverride="localhost:<minio-port>"