Consume Multiple Messages at once

Is it possible to do something like this in Confluent .NET API?

  public void run() {
    try {
      consumer.subscribe(topics);

      while (!shutdown.get()) {
        ConsumerRecords<K, V> records = consumer.poll(500);
        records.forEach(record -> process(record));
      }
    } finally {
      consumer.close();
      shutdownLatch.countDown();
    }
  }

This is taken from Java Documentation from docs.confluent.io.

[mhowlett]

sorry for the terseness, was on my phone.

the consumer delivers messages to your application from a cache - behind the scenes messages are retrieved from brokers in batches. There might be a slight improvement to be had by returning batches to the application because of reduced marshaling overhead between librdkafka and the C# layer, but I doubt it is very much. The consume benchmark (in the tests folder) can do about 1M msg/s on my machine (has comparable performance to the java consumer).

[mhowlett]

it’s quite a lot of effort to build this and v. unlikely we’ll ever do it as we view this as an inferior API