How do I implement a producer inside a web api project

Description

I am trying to implement a producer inside a .NET framework WebAPI project. I found one of the threads #360 where I found a solution.

public class KafkaClient : IKafkaClient
{
    private Producer<string, string> producer;

    public KafkaClient(IConfiguration globalconf)
    {
        var config = new Dictionary<string, object>
        {
            { "bootstrap.servers", "http://localhost:9092" }
        };

        producer = new Producer<string, string>(config, new StringSerializer(Encoding.UTF8), new StringSerializer(Encoding.UTF8));
    }

    public async Task<Message<string, string>> Produce(string key, string val)
    {
        var resp = await producer.ProduceAsync("QuoteTest", key, val);
        return resp;
    }
}

Now when I call the produce method from the action method using await producer.Produce("hello1", "world1") It takes a long time and then returns a “Local: Message timed out” error. However this exact same piece of code works when I use it in a .NET Console app. I have tried implementing this in .NET Core 2.0 WebAPI project but I face the same issue. Here is the response object from the Produce method

How to reproduce

Implement the above code snippet inside a .NET framework/Core 2.0 WebAPI project and call the method from an action.

Checklist

Please provide the following information:

• Confluent.Kafka nuget version: 0.116
• Apache Kafka version: 2.12-2.2.0
• Client configuration: .NET framework WebAPI project
• Operating system: Win 10

[mhowlett]

it would be a good feature for us to do a runtime check for this. note that kafka has a custom binary protocol, doesn’t use http.

[souptikmakarov]

Thanks for the info!