Slow performance

I have been testing this client. I made couple of performance tests but the result were too low. I am not sure if I am doing something wrong but here is the configuration.

I deployed pulsar to kubernetes. With it is comes with toolset which has pulsar-perf tool. When I run the command:

bin/pulsar-perf produce --batch-max-messages 1000 -c 1 -r 200000 -s 750 non-persistent://test/test/test -c is for tcp connection, -s is for size, -r is for rate The default number of threads is 1

I get around 200k messages per second.

Now, I implemented a simple dotnet worker to see the results here is the code:

var client = await new PulsarClientBuilder()
                .ServiceUrl("pulsar://pulsar-broker.pulsar:6650")
                .BuildAsync();

var producer = await client
    .NewProducer()
    .Topic("non-persistent://test/test/test")
    .CreateAsync();

byte[] buffer = new byte[750];
Random.Shared.NextBytes(buffer);

while (true)
{
    await producer.SendAndForgetAsync(buffer);
}

With this code I get around 15k messages per second.

I would expect the number to be close but they are far from each what could be the reason?

[Lanayx]

@aeb-dev I’ve recently published a fix for the issue above, now SendAsync in load test won’t lead to the program hang ( actually it was not hanging, but batching stopped working properly)

[Lanayx]

You can try yourself, by adding a consumer and verifying delivered messages count and timing. I’ve just run another local test with maxPendingMessages(100000) and now .net and java clients show the same time of 8200ms locally. The only issue I see is that it seems that with default queue side and using SendAsync in .net client without awaiting just hangs when doing final await, I need to understand why this happens. However with await producer.SendAndForgetAsync everything works as expected.