Unable to consume messages from a topic

Hi,

i’m just testing the library, but i’m not able to consume any message from my topic. I created a topic named parallelConsumerTest, with 10 partitions, and produced 1 million records in it. I already checked that the topic is not empty.

Here is my Java consumer:

Consumer<String, String> consumer = ConsumerCreator.createParallelConsumer();

ParallelConsumerOptions<String, String> options = ParallelConsumerOptions.<String, String>builder()
		.consumer(consumer)
		.ordering(ParallelConsumerOptions.ProcessingOrder.PARTITION)
		.maxConcurrency(10)
		.build();

ParallelStreamProcessor<String, String> parallelConsumer = ParallelStreamProcessor.createEosStreamProcessor(options);
parallelConsumer.subscribe(Collections.singletonList("parallelConsumerTest"));

System.out.println("PARALLEL CONSUMER SUBSCRIBED");
Map<String, String> mapRecord = new HashMap<>();

parallelConsumer.poll(record -> {

	System.out.println("Concurrently processing a record: {}" + record);
	mapRecord.put(record.key(), record.value());
});

System.out.println("RECORD COUNT: " + mapRecord.size());

What happen is that my mapRecord is always empty and i can’t understand why. Please note that using a “standard” Kafka Consumer, everything works fine. What am i doing wrong?

Thanks in advance!

Mauro

[astubbs]

i was using an old version of the Kafka-clients What version were you using?

Thanks for the code, but can you add a test to it which reproduces the problem? If you a unit test doesn’t do it, try an integration test with test containers. Happy to help where I can, but I don’t have much time 😃 I’m curious to see what the issues is though…

[mroiter-larus]

I solved the problem! Obviously it wasn’t an issue with the parallel consumer library. Since i used 2 consumers, the standard and the parallel, i forgot to assign different group.id to them. My bad!

Thanks anyway for your availability!