is_server_live results in connection reset

Description I have an https endpoint serving Triton that I can get 200 responses from with curl, i.e.:

curl -v https://gopalv-custom-container2.westus2-main.inference.ml.azure.com/v2/health/live -H "Authorization: Bearer <token here>"

But when I try accessing it from the Python client, i.e.

client = tritonhttpclient.InferenceServerClient("gopalv-custom-container2.westus2-main.inference.ml.azure.com", ssl=True)
headers = {'Authorization': 'Bearer <token here>'}
client.is_server_live(headers=headers)

I get

Traceback (most recent call last):  File "/home/gopalv/miniconda3/envs/azureml/lib/python3.7/site-packages/geventhttpclient/connectionpool.py", line 163, in get_socket    return self._socket_queue.get(block=False)  File "src/gevent/queue.py", line 334, in gevent._gevent_cqueue.Queue.get  File "src/gevent/queue.py", line 349, in gevent._gevent_cqueue.Queue.get  File "src/gevent/queue.py", line 318, in gevent._gevent_cqueue.Queue._Queue__get_or_peek
    
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/gopalv/miniconda3/envs/azureml/lib/python3.7/site-packages/tritonclient/http/__init__.py", line 335, in is_server_live
    query_params=query_params)
  File "/home/gopalv/miniconda3/envs/azureml/lib/python3.7/site-packages/tritonclient/http/__init__.py", line 256, in _get
    response = self._client_stub.get(request_uri, headers=headers)
  File "/home/gopalv/miniconda3/envs/azureml/lib/python3.7/site-packages/geventhttpclient/client.py", line 266, in get
    return self.request(METHOD_GET, request_uri, headers=headers)
  File "/home/gopalv/miniconda3/envs/azureml/lib/python3.7/site-packages/geventhttpclient/client.py", line 226, in request
    sock = self._connection_pool.get_socket()
  File "/home/gopalv/miniconda3/envs/azureml/lib/python3.7/site-packages/geventhttpclient/connectionpool.py", line 166, in get_socket
    return self._create_socket()
  File "/home/gopalv/miniconda3/envs/azureml/lib/python3.7/site-packages/geventhttpclient/connectionpool.py", line 127, in _create_socket
    raise first_error
  File "/home/gopalv/miniconda3/envs/azureml/lib/python3.7/site-packages/geventhttpclient/connectionpool.py", line 114, in _create_socket
    sock = self._connect_socket(sock, sock_info[-1])
  File "/home/gopalv/miniconda3/envs/azureml/lib/python3.7/site-packages/geventhttpclient/connectionpool.py", line 248, in _connect_socket
    return gevent.ssl.wrap_socket(sock, **ssl_options)
  File "/home/gopalv/miniconda3/envs/azureml/lib/python3.7/site-packages/gevent/_ssl3.py", line 798, in wrap_socket
    ciphers=ciphers)
  File "/home/gopalv/miniconda3/envs/azureml/lib/python3.7/site-packages/gevent/_ssl3.py", line 311, in __init__
    raise x
  File "/home/gopalv/miniconda3/envs/azureml/lib/python3.7/site-packages/gevent/_ssl3.py", line 307, in __init__
    self.do_handshake()
  File "/home/gopalv/miniconda3/envs/azureml/lib/python3.7/site-packages/gevent/_ssl3.py", line 663, in do_handshake
    self._sslobj.do_handshake()
ConnectionResetError: [Errno 104] Connection reset by peer

Triton Information tritonclient==2.8.0 triton version = 20.11

Using the NVIDIA Triton container.

To Reproduce Steps to reproduce the behavior.

Not including config file since this behavior is not model-specific.

Expected behavior is_server_live() should return True

[tanmayv25]

~@gvashishtha If you can provide a minimal repro instructions then I can take look into what’s failing.~ NVM got the token from Mahan.

[tanmayv25]

@1994sugar Can you create a new github issue with all the details? Also. are you using the latest triton release?