question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Ability to use Kafka filtering and recordFilterStrategy

See original GitHub issue

Hello, I am building an application which produces and consumes messages to/from the same kafka topic (shared with other applications). Therefore, I want to be able to filter out messages produced by the application itself. To do that with efficiency, I want to filter messages as soon as possible.

I think that FilteringAcknowledgingMessageListenerAdapter is the solution. But to use it, I need to be able to pass a RecordFilterStrategy to KafkaMessageDrivenChannelAdapter.

Would it be ok to add a specific kafka property describing a RecordFilterStrategy class name? If not, how can I do that?

Issue Analytics

  • State:closed
  • Created 7 years ago
  • Comments:15 (14 by maintainers)

github_iconTop GitHub Comments

1reaction
mbogoevicicommented, Feb 12, 2017

@artembilan My mistake - there’s an else branch that I missed, so you’re right.

In any case, my original observation remains: I think we should rather use a Filter in a SCSt solution or as Gary suggested, go with S-I-Kafka or Spring Kafka directly.

0reactions
olegzcommented, Aug 22, 2019

@ashankabiswas Please do not comment on closed issues especially with questions… Please use Stack Overflow channel.

Read more comments on GitHub >

github_iconTop Results From Across the Web

What should be the best way to filter the kafka message
When you use @KafkaListener , set the RecordFilterStrategy (and ... filtering options that could help you, though it has the ability to send ......
Read more >
Filter (Apache Kafka) | Confluent Documentation
This document provides usage information for the Apache Kafka Filter SMT org.apache.kafka.connect.transforms.Filter and how to use predicates.
Read more >
RecordFilterStrategy (Spring for Apache Kafka 3.0.0 API)
Filter an entire batch of records; to filter all records, return an empty list, not null. Parameters: records - the records. Returns: the...
Read more >
Demystifying Spring Kafka - Medium
Well, Spring-Kafka provides a way to filter out those messages using RecordFilteringStrategy. But, catch is that is post deserialisation filtering, ...
Read more >
Intro to Apache Kafka with Spring - Baeldung
A quick and practical guide to using Apache Kafka with Spring. ... This can be done by setting a RecordFilterStrategy to the ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found