question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Kafka partition key clarification

See original GitHub issue

In Kafka binding specification, it’s specified that the message key should be included in the event as key extension. But then, the specification links to the partitioning extension specification, which states that the key extension should be called partitionKey.

Which of the ones should be used?

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:8 (2 by maintainers)

github_iconTop GitHub Comments

1reaction
duglincommented, Mar 26, 2020

@clemensv took an AI to write-up a proposal

1reaction
slinkydevelopercommented, Mar 12, 2020

The key in a kafka message is well defined by the kafka message specification already: I don’t see the reason to add the partitioning extension, nor the partitionKeyExtractor thing which is just confusing. I think we should reword, removing both the partitioning spec link and the partitionKeyExtractor, and just state that the Kafka message key maps to the key extension of the event.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Kafka Partition Key - eduCBA
Guide to Kafka Partition Key. Here we discuss the introduction, working, kafka partition / partition key calculation and example.
Read more >
Topics, partitions and keys - apache kafka - Stack Overflow
First, we must understand that the producer is responsible for choosing which record to assign to which partition within the topic. Now, lets ......
Read more >
Understanding Kafka Topic Partitions | Event-driven Utopia
Everything in Kafka is modeled around partitions. They rule Kafka's message storage, scalability, replication, and message movement.
Read more >
Kafka Partitioning Class : Clarification - Cloudera Community
Solved: We create Kafka Partition using kafka-topics.sh. Would like to validate my understanding is correct. - 95540.
Read more >
Kafka 3.3 Documentation
When a new event is published to a topic, it is actually appended to one of the topic's partitions. Events with the same...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found