Kafka partition key clarification
See original GitHub issueIn Kafka binding specification, it’s specified that the message key should be included in the event as key
extension. But then, the specification links to the partitioning extension specification, which states that the key extension should be called partitionKey
.
Which of the ones should be used?
Issue Analytics
- State:
- Created 4 years ago
- Comments:8 (2 by maintainers)
Top Results From Across the Web
Kafka Partition Key - eduCBA
Guide to Kafka Partition Key. Here we discuss the introduction, working, kafka partition / partition key calculation and example.
Read more >Topics, partitions and keys - apache kafka - Stack Overflow
First, we must understand that the producer is responsible for choosing which record to assign to which partition within the topic. Now, lets ......
Read more >Understanding Kafka Topic Partitions | Event-driven Utopia
Everything in Kafka is modeled around partitions. They rule Kafka's message storage, scalability, replication, and message movement.
Read more >Kafka Partitioning Class : Clarification - Cloudera Community
Solved: We create Kafka Partition using kafka-topics.sh. Would like to validate my understanding is correct. - 95540.
Read more >Kafka 3.3 Documentation
When a new event is published to a topic, it is actually appended to one of the topic's partitions. Events with the same...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
@clemensv took an AI to write-up a proposal
The key in a kafka message is well defined by the kafka message specification already: I don’t see the reason to add the partitioning extension, nor the
partitionKeyExtractor
thing which is just confusing. I think we should reword, removing both the partitioning spec link and thepartitionKeyExtractor
, and just state that the Kafka message key maps to thekey
extension of the event.