Ability to commit offset of consumer
See original GitHub issueHi. There is an option for the Kafka Rest Proxy to commit offsets as you can see here. I want this options to be available for a consumer i created. something like :
var kafkaRest = require('kafka-rest');
var kafka = new kafkaRest({ url: restProxyServerUrl });
kafka.consumer(myConsumerGroup).join(
{ 'format': `avro`, 'auto.offset.reset': `smallest`, `socket.timeout.ms`: `20000` }
, function(error, consumer) {
var listener = consumer.subscribe(topic);
listener.on(`data`, function(messages) {
consumer.commitOffset();
});
});
notice the consumer.commitOffset();
- it is like making a HTTP request to this with the consumerGroup and raw name from the instance.
Issue Analytics
- State:
- Created 8 years ago
- Reactions:1
- Comments:7 (4 by maintainers)
Top Results From Across the Web
Kafka - When to commit? - Quarkus
It commits the offset, indicating that all the previous records from that partition have been processed. So, if a consumer stops and comes ......
Read more >Kafka Consumer | Confluent Documentation
The offset commit policy is crucial to providing the message delivery guarantees needed by your application. By default, the consumer is configured to...
Read more >KafkaConsumer (clients 0.9.0.1 API) - Apache Kafka
Automatic Offset Committing. This example demonstrates a simple usage of Kafka's consumer api that relying on automatic offset committing. Properties props = ...
Read more >Learn how Kafka Consumers work in Groups and ... - YouTube
Learn how Kafka Consumers work in Groups and how they commit offsets in Apache Kafka--Don't forget to subscribe to get more content about ......
Read more >Kafka Consumer offset commit check to avoid ... - Stack Overflow
As the offset 10 was not committed, the new consumer will start reading again offset 10 before jumping to the next batch and...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Is there any update on this? From what I see, there isn’t support for this in the library.
+1
Is there a was to commit the offset manually, until we get this implemented? Thanks!