unable to consume specific amount of messages without waiting with a setTimeout

Environment Information

• OS [e.g. Mac, Arch, Windows 10]: RedHat
• Node Version [e.g. 8.2.1]: 10.6.0
• NPM Version [e.g. 5.4.2]: 6.1.0
• C++ Toolchain [e.g. Visual Studio, llvm, g++]:
• node-rdkafka version [e.g. 2.3.3]: 2.3.2

// Non-flowing mode
consumer.connect();

consumer
  .on('ready', function() {
    consumer.subscribe(['librdtesting-01']);

    // Read only 1000 messages
    consumer.consume(1000); // <---------- This is not working...
  })
  .on('data', function(data) {
    console.log('Message found!  Contents below.');
    console.log(data.value.toString());
  });

If i’m replacing the line that I’ve marked above with the following, then it does work:

setTimeout(() => consumer.consume(1000), 60000); // <-- this is working..

Could this be related to node-rdkafka? or is it something that has to do with my kafka configuration?

[rosshadden]

Multiple people have the same problem (myself included). This should not be closed.

[thebigredgeek]

Is there not an error event emitted? I am seeing something very similar, but error is null and the messages array is empty. It seems like ready is being fired before the consumer has fetched partition offsets, according to the logs when i set debug to `consumer. Also, it appears that the offset is being incremented even though I am not receiving the messages through the data or consume callbacks