Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Throughput decreases when receiving a large number of messages

See original GitHub issue

When receiving a large number of messages over a short period of time (e.g. 250,000 messages over a period of 2 minutes,) I am seeing very high CPU usage (95%+) and memory usage (3 GB+.) The server initially accepts messages quickly but then slows down to the point of accepting only one message every few seconds. Profiling showed contention related to TaskExtensions.WithTimeout()'s usage of Task.Delay(). I’m using .NET Core 2.0 on Windows 10 x64. My application is doing almost nothing - just calling Interlocked.Increment() to track the amount of messages it receives, so I don’t suspect any code in my application.

Issue Analytics

State:
Created 5 years ago
Comments:12 (8 by maintainers)

Top GitHub Comments

1reaction

cosullivancommented, May 28, 2018

Sorry, I forgot to merge. Have done it now.

0reactions

cosullivancommented, Oct 5, 2018

Is this still an issue?

No, this is resolved.

Top Results From Across the Web

Latency vs Throughput – Understanding the Difference

If the majority of messages are delivered successfully then throughput will be considered high. In contrast, a low rate of successful delivery ...

Service Bus Premium and Standard messaging tiers

Sending large messages will result in decreased throughput and increased latency. While 100 MB message payloads are supported, it's recommended ...

Network throughput - Wikipedia

Network throughput refers to the rate of message delivery over a communication channel, such as Ethernet or packet radio, in a communication network....

What is throughput? | Definition from TechTarget

Throughput is necessarily lower than bandwidth because bandwidth represents the maximum capabilities of a network rather than the actual transfer rate. A ...

Optimizing Kafka Performance

Increasing the batch size of messages increases throughput, and combining this with compression makes sure that a large number of messages are being ......