Grpc Under Load Problem

Hi ,

I’m using grpc client streaming with .Net 5 and i need to handle 1000 simultaneous request and each request should take 50 milliseconds.

currently when i send 1000 simultaneous request it took 9 seconds to be handled and each request takes about 7 seconds(average).

Machine specs

• Windows Server 2019
• 32 GB RAM
• 16 Core

Channel Configuration

  var channel = GrpcChannel.ForAddress(ServiceUrl, new GrpcChannelOptions
            {
                HttpHandler = new SocketsHttpHandler
                {
                    EnableMultipleHttp2Connections = true,
                    MaxConnectionsPerServer = 1000
                }
            });

Kestrel Configuration


webBuilder.ConfigureKestrel((context, options) =>
                {
                    var port = context.Configuration.GetSection("HostPort").Get<int>();
                    options.ListenAnyIP(port, o => o.Protocols = HttpProtocols.Http2);
                    options.Limits.Http2.MaxStreamsPerConnection = 1000;
                });

[davidfowl]

@melfeqy I’d recommend using dotnet counters to get some top level metrics about your applications’ behavior.

[rafikiassumani-msft]

@melfeqy We will close this issue as we believe we have provided enough guidance to help resolve your problem.