Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

consumer is not getting messages after some time of running

See original GitHub issue

Environment Information

OS: Docker of carbon-alpine
Node Version 8.11.4
NPM Version 5.6.0
node-rdkafka version 2.3.2

Im running 3 instances of app that listening for a specific events. at certain point, 2 of the 3 instances is not getting the events anymore.

when inspecting the kafka, I see that:

TOPIC                 PARTITION  CURRENT-OFFSET  LOG-END-OFFSET  LAG             CONSUMER-ID                                                           HOST             CLIENT-ID
forgetPasswordInit    0          5558            5558            0               man-mailing-api-A-04abb206-9754-496b-984a-f740d1bdde73 /192.168.202.223 man-mailing-api-A
forgetPasswordInit    1          -               5472            -               man-mailing-api-B-39c418ef-5257-4db2-a923-ec1357f89c5e /192.168.202.221 man-mailing-api-B
forgetPasswordInit    2          -               5526            -               man-mailing-api-C-171c352c-5f27-42e6-8847-8147aa4bbf0b /192.168.202.222 man-mailing-api-C

As you can see, the CURRENT-OFFSET is shown only for the instance that listening.

Any suggestions of how to debug it? When restarting the instances everything is back to normal

Issue Analytics

State:
Created 5 years ago
Reactions:5
Comments:11 (1 by maintainers)

Top GitHub Comments

2reactions

carlessistarecommented, Apr 2, 2019

Multiple issues related to the same topic and no solutions. The stale bot keeps closing this issue on and on because no activity, but the problem is still there

1reaction

brickbitecommented, Dec 27, 2018

hi @nervgh, thanks for linking me to that. originally I was thinking it might be related to issue #424. I’ll give your solution a shot and come back if there’s something else to report.

Top Results From Across the Web

Simple Kafka Consumer not receiving messages

First check what all the groups are available by using : ./kafka-consumer-groups.sh --bootstrap-server localhost:9092 --list.

Standard Kafka consumer hangs and does not output messages

Symptoms. The standard Kafka consumer ( kafka-console-consumer.sh ) is unable to receive messages and hangs without producing any output.

kafka consumer not showing the consumed messages

But when the time comes to consumer to show the messages: there is nothing although the command seems to be executed, but no...

Kafka Consumer not consuming new messages randomly

Hello, We have finally found the root cause of this issue. It was due to the consumer.request.timeout.ms ...

Consumers

Client can lose their connection to RabbitMQ. When connection loss is detected, message delivery stops. Some client libraries offer automatic connection ...