How to properly timeout a notification listener?

I need to load an object from MinIO as soon as it is uploaded. For that, I use the MinIO python client’s Minio.listen_bucket_notification() and listen for the “s3:ObjectCreated:*” event. The client only listens for a single object.

It can happen that the file does not get created in time. So I want to stop listening for this notification after a while. Looking at the implementation (https://github.com/minio/minio-py/blob/master/minio/api.py#L868), I don’t see an option for a timeout, or any proper way for me to close the response and release the connection to MinIO from the outside.

What is the proper way to time out a MinIO client’s listen_bucket_notification() iterator?

[neuneck]

Thank you for the quick action @balamurugana

[neuneck]

FYI: I also verified that using the events object directly, i.e. not as a context manager will leak the connection. Running

from minio.api import Minio
from iterators import TimeoutIterator

minio_client = Minio(endpoint="127.0.0.1:9000",
                     access_key="AKIAIOSFODNN7EXAMPLE",
                     secret_key="wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY",
                     secure=False)


if not minio_client.bucket_exists("example"):
    minio_client.make_bucket("example")

events = minio_client.listen_bucket_notification("example")
it = TimeoutIterator(events, timeout=5)
for event in it:
    if event is it.get_sentinel():
        print("Sentinel received")
        break
    else:
        print("event")

print(events)
print(events._response)

Gives

Sentinel received
<minio.datatypes.EventIterable object at 0x7f5c9991ab80>
<urllib3.response.HTTPResponse object at 0x7f5c998cc5e0>

Whereas the code above gives

Sentinel received
<minio.datatypes.EventIterable object at 0x7f294a781b80>
None