[Question] How to detect connection failures and is there a hard limit for re-connection?

The consumer currently attempts to re-connect to brokers after encountering connectivity issues. Is it possible to apply a global timeout/limit to consumer’s re-connection or disable it completely? Is it possible to somehow detect the connection loss in the user code?

As it stands, the messages processed lately are by definition incorrect in the system I work on, so I have a side channel that can invalidate the output for my clients. In general, I would prefer getting an exception from Consume to losing time on re-connection attempts that take longer than a few seconds when all brokers are not available.

[amirvalhalla]

@quixoticaxis , so as far as I don’t know for what kind of business your writing codes , I’m suggesting you to use AdminClient to managing your brokers etc… , whenever you get all your brokers or just specific broker is/are unavailable you can clean/delete your topics by this way your clients couldn’t get any more messages from Kafka , meanwhile whenever your brokers come available again , your producer will create topics again and other cycles will occure

[amirvalhalla]

The consumer currently attempts to re-connect to brokers after encountering connectivity issues. Is it possible to apply a global timeout/limit to consumer’s re-connection or disable it completely? Is it possible to somehow detect the connection loss in the user code?

As it stands, the messages processed lately are by definition incorrect in the system I work on, so I have a side channel that can invalidate the output for my clients. In general, I would prefer getting an exception from Consume to losing time on re-connection attempts that take longer than a few seconds when all brokers are not available.

hi @quixoticaxis

about your first question (set timeout/limit consumer connection) , you can use SessionTimeoutMs property in ConsumerConfig , E.g

var consumerConfig = new ConsumerConfig()
{
    SessionTimeoutMs = (int)TimeSpan.FromSeconds(10).TotalMilliseconds;
};

about your second question to detecting the bootstrap server is available or not I’ll refer you to this link. in result , you should use AdminClient to managing your topics , brokers etc…