Confluent.Kafka.ConsumeException: Local: Timed out

Description

We are experiencing the below error intermittently while consuming the messages from Kafka

Confluent.Kafka.ConsumeException: Local: Timed out at Confluent.Kafka.Consumer2.ConsumeImpl[K,V](Int32 millisecondsTimeout, IDeserializer1 keyDeserializer, IDeserializer1 valueDeserializer) at Confluent.Kafka.Consumer2.Consume(CancellationToken cancellationToken)

How to reproduce

The below configuration is using in our application return new ConsumerConfig { BootstrapServers = _consumerConfiguration.BootstrapServers, GroupId = _consumerConfiguration.GroupId, SessionTimeoutMs = 100000, AutoOffsetReset = AutoOffsetReset.Earliest, EnablePartitionEof = true, EnableAutoCommit = _consumerConfiguration.EnableAutoCommit };

Checklist

Please provide the following information:

• A complete (i.e. we can run it), minimal program demonstrating the problem. No need to supply a project file.
• Confluent.Kafka nuget version.
• Apache Kafka version.
• Client configuration.
• Operating system.
• Provide logs (with “debug” : “…” as necessary in configuration).
• Provide broker log excerpts.
• Critical issue.

[kalpanathakur08]

ed-alertedh, I am seeing similar issue, have you got to the solution to it?

After these errors, some consumers doesn’t resume message/record processing even if partition has records and consumer is healthy and polling.

1. “error”:“Local: Timed out”,“error”:“commit error” : This is happening on commit.
2. “error”:“GroupCoordinator: 1 request(s) timed out: disconnect (after 6847266ms in state UP, 1 identical error(s) suppressed)” socket.timeout.ms is set to 60000ms right now.

[yangerlei1207]

We have the same issue in Producer, Exception like this: Confluent.Kafka.ProduceException2[System.String,System.String]: Local: Message timed out at Confluent.Kafka.Producer2.ProduceAsync(TopicPartition topicPartition, Message`2 message, CancellationToken cancellationToken)