ProduceAsync still deadlocks for nuget version: Confluent.Kafka -Version 1.0.0-experimental-12

Description

I upgraded to Confluent.Kafka -Version 1.0.0-experimental-12 according to what you mentioned here. If I am not wrong, this package includes 1.0-experimental-9.

#545

But I still see ProduceAsync deadlock (for a console application). I added debug: all in the config and captures the following log:

Here is the relevant code:

  var config = new Dictionary<string, object> {
            { "bootstrap.servers", "192.168.0.228:9092" },
            { "queue.buffering.max.ms", 1 },
            { "socket.blocking.max.ms", 1 },
            { "debug", "all"}
        };
        _producer = new Producer<string, string>(config, new StringSerializer(Encoding.UTF8), new StringSerializer(Encoding.UTF8));

    public void Publish<T>(T message) where T : IExternalMessage
    {
        if (message == null) throw new ArgumentNullException("message");
        var value = JsonConvert.SerializeObject(message, ExternalMessageConverters.SerializerSettings);
        Logger.Info("Publishing External Message: " + message.GetType().FullName + "\r\n" + value);
        var partition = new TopicPartition(_topicNamePrefix + message.Topic, new Partition(message.PartitionKey % 20));
        var m = new Message<string, string>
        {
            Key = message.Key,
            Value = value
        };
        Console.WriteLine("BEGIN ProduceAsync: {0}", DateTime.Now);
        _producer.ProduceAsync(partition, m).Wait();
        Console.WriteLine("END ProduceAsync: {0}", DateTime.Now);
        //AsyncContext.Run(async () =>
        //{
        //});
        Logger.Info("DONE Publishing Message");
    }

The entire log is attached below:

entire.log

How to reproduce

Checklist

Please provide the following information:

• Confluent.Kafka nuget version: Confluent.Kafka -Version 1.0.0-experimental-12
• Apache Kafka version: kafka_2.11-2.0.0
• Client configuration: see code above
• Operating system: Client runs on Windows 7 (my dev machine). Kafka Server runs in Ubuntu 14.04.5 LTS
• Provide logs (with “debug” : “…” as necessary in configuration)
• Provide broker log excerpts
• Critical issue

[mhowlett]

thanks for the input @foresightyj. re-opening as a reminder to investigate further.

[kiedd]

There is also possibility, that using Task.Wait() on asynchronous method (which is ProduceAsync) causes deadlock. If you want to execute async method synchronously, you should use GetAwaiter().GetResult()