question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Use Kafka client specific consumer/producer config properties

See original GitHub issue

Currently, the configuration of the Kafka consumer for receiving command messages in the Command Router component is done via the generic Kafka configuration properties:

hono:
  kafka:
    consumerConfig:
      bootstrap.servers: [...]
      [...]

Especially with the introduction of another kind of Kafka consumer in the Command Router (see #2837), there should be a way to configure the Kafka command consumer explicitly.

The Command Router Kafka command consumer config needs:

  • standard Kafka config properties passed on to the Kafka consumer
  • specific properties introduced by the Hono consumer classes, like HonoKafkaConsumer#POLL_TIMEOUT and the AsyncHandlingAutoCommitKafkaConsumer#CONFIG[*] properties (see also the Hono KafkaConsumerConfigProperties class, currently not used for these classes)

The definition of the new config structure should be done taking into account how the AMQP messaging network command consumer is configured. This is currently done like this:

hono:
  command:
    name: 'Hono Command Router'
    host: someHost
    tlsEnabled: true
    trustStorePath: /etc/hono/trusted-certs.pem
    initialCredits: 2000
    sendMessageTimeout: 5000
    linkEstablishmentTimeout: 1000

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:12 (12 by maintainers)

github_iconTop GitHub Comments

1reaction
b-abelcommented, Nov 5, 2021

Yes. I would move the property commonClientConfig from the current class AbstractKafkaConfigProperties into a new one. It could be called for example KafkaClientConnectionConfigProperties. On the other Kafka config classes, I would then add a setter for this new type.

0reactions
b-abelcommented, Dec 9, 2021

Resolved by #2972 and #2989.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Kafka Consumer Configurations for Confluent Platform
The Apache Kafka® consumer configuration parameters are organized by order of importance ... This property is required if the consumer uses either the...
Read more >
Kafka 3.3 Documentation
In this quickstart we'll see how to run Kafka Connect with simple connectors that import data from a file to a Kafka topic...
Read more >
Documentation - Apache Kafka
In Kafka the communication between the clients and the servers is done with a simple, high-performance, language agnostic TCP protocol.
Read more >
KafkaConsumer (kafka 2.5.0 API)
A client that consumes records from a Kafka cluster. This client transparently handles the failure of Kafka brokers, and transparently adapts as topic ......
Read more >
KafkaConsumer (kafka 0.10.0.1 API)
Failure to close the consumer after use will leak these connections. ... Each Kafka consumer is able to configure a consumer group that...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found