question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Replication factor option for Kafka Stream binder

See original GitHub issue

The documentation states that the property spring.cloud.stream.kafka.binder.replicationFactor for the Kafka binder sets the replication factor for auto-created topics; there is no mention of a similar property for the Kafka Streams binder.

I have an application using a KStream. I can only successfully set the replication factor for the KStream topic when I use the option spring.cloud.stream.kafka.streams.binder.replicationFactor (note the word “streams”). This option is not explicitly documented for the Kafka Streams binder.

Perhaps such plain Kafka binder options can be re-used for the Kafka Streams binder, but if this is the case it is not entirely clear. Can you clarify?

Documentation: https://cloud.spring.io/spring-cloud-stream-binder-kafka/spring-cloud-stream-binder-kafka.html

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:8 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
sobychackocommented, Oct 15, 2019

@boonware All the properties available in KafkaBinderConfigurationProperties for topic creation (such as the replication factor) is available for the Kafka Streams binder also. However, as you already noticed, when used in the context of Kafka Streams types, you need to prefix the configuration with spring.cloud.stream.kafka.streams.binder. Maybe we should be more clear on the docs about this. Contributions are welcomed.

0reactions
sobychackocommented, Oct 22, 2019

@boonware Yep. Please feel free to close it. Ping here again if there are further changes required.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Spring Cloud Stream Kafka Binder Reference Guide
spring.cloud.stream.kafka.binder.replicationFactor. The replication factor of auto-created topics if autoCreateTopics is active. Can be overridden on each ...
Read more >
Kafka Streams replication factor not applied to state store ...
1 Answer 1 ... Starting with version 2.4, the AdminClient can now set the replication factor to -1 in NewTopic , meaning that...
Read more >
Configuring a Streams Application | Confluent Documentation
This specifies the replication factor of internal topics that Kafka Streams creates when local states are used or a stream is repartitioned for...
Read more >
Configuring a Streams Application - Apache Kafka
This specifies the replication factor of internal topics that Kafka Streams creates when local states are used or a stream is repartitioned for...
Read more >
spring-cloud-stream-binder-kafka - Gitee
The Apache Kafka Binder implementation maps each destination to an Apache Kafka topic. The consumer group maps directly to the same Apache Kafka...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found