Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

`list_consumer_group_offsets` is always 10x slower that origin `kafka-consumer-groups.sh --describe`

See original GitHub issue

list_consumer_group_offsets is always 10x slower that origin kafka-consumer-groups.sh --describe.

bin/kafka-consumer-groups.sh --bootstrap-server 127.0.0.1:9092 --describe --group test

admin_client = KafkaAdminClient(bootstrap_servers=["127.0.0.1:9092"])
admin_client.list_consumer_group_offsets('test')

kafka version 1.1 kafka-python version 1.4.6

Issue Analytics

State:
Created 4 years ago
Comments:6

Top GitHub Comments

1reaction

jeffwidmancommented, Jun 20, 2019

@jdxin0 can you try this on master?

I saw absolutely massive performance increases when fetching consumer offsets after #1823… details in https://github.com/dpkp/kafka-python/pull/1823#issuecomment-503834550.

If you’re still seeing the issue on latest master, I’m happy to re-open, but I suspect this should be solved for you…

0reactions

nbommu1commented, Aug 20, 2019

it works fine with single broker but same slow response list_consumer_groups() if it is cluster.

Top Results From Across the Web

What command shows all of the topics and offsets of partitions ...

Kafka ships with some tools you can use to accomplish this. List topics: # ./bin/kafka-topics.sh --list --zookeeper localhost:2181 test_topic_1 test_topic_2 ...

kafka-consumer-groups | CDP Public Cloud

This tool is primarily used for describing consumer groups and debugging any consumer offset issues, like consumer lag. The output from the tool...

Kafka: The Definitive Guide - Confluent Official Asset Library

Every enterprise application creates data, whether it consists of log messages, metrics, user activity, or outgoing messages.

How to change or reset consumer offset in Kafka?

Use the kafka-consumer-groups along with the consumer group id followed by a describe. kafka-consumer-groups.sh --bootstrap-server ...