Object reference null while trying to produce to topic on higher loads during perf testing

Description

We are doing performance testing and trying to produce around 24 million messages to a topic with Partition Count 36 and Replication Factor 3. We are calling ProduceAsync method to push messages. We are getting below exception on higher loads:

System.NullReferenceException: Object reference not set to an instance of an object. at Confluent.Kafka.Impl.SafeKafkaHandle.marshalHeaders(IEnumerable1 headers) at Confluent.Kafka.Impl.SafeKafkaHandle.Produce(String topic, Byte[] val, Int32 valOffset, Int32 valLength, Byte[] key, Int32 keyOffset, Int32 keyLength, Int32 partition, Int64 timestamp, IEnumerable1 headers, IntPtr opaque) at Confluent.Kafka.Producer2.ProduceImpl(String topic, Byte[] val, Int32 valOffset, Int32 valLength, Byte[] key, Int32 keyOffset, Int32 keyLength, Timestamp timestamp, Partition partition, IEnumerable1 headers, IDeliveryHandler deliveryHandler) at Confluent.Kafka.Producer2.ProduceAsync(TopicPartition topicPartition, Message2 message, CancellationToken cancellationToken)

How to reproduce

Checklist

1. Confluent.Kafka 1.7.0.

[CwPiyush]

We went with other alternatives. I am closing the ticket for now.

[anchitj]

@CwPiyush I tried to reproduce the issue locally on my system with 25M messages having headers, partition count= 36, and replication factor = 3 with the Benchmark test and didn’t face any troubles in Producer.

To further help in the investigation, can you please do:

1. Provide the sample code for your producer with the configuration that you are testing with?
2. Can you try running Benchmark test as well and see if it errors out or not?