bulk queue with timer - how to construct? cargo? timeout?

I am trying to figure out how to use async to create a “cargo-timeout-queue”.

Essentially, I am trying to cache and throttle downstream i/o behaviour. Think of it as “cargo with minimum batch size and timeout to override.”

const q = async.cargo_min_with_timeout(handler, 10, 5000);

The above would:

• create a cargo-like queue
• that would not call handler (first arg) until it has 10 (second arg) items to send together
• but if it is at least 5000 (last arg) milliseconds since last time a handler was called and there are items on the queue, call handler with what we have

This allows me to combine input objects for efficient downstream i/o processing by handler, but ensures that it doesn’t wait too long. There is a tension between batch size - larger can be better - and delay - I don’t want to wait too long.

Is there some way to combine async functions to get this behaviour? Or do I need to build it?

Thanks. Once again, async is a mainstay in my JS work. 😃

[aearly]

Also, we are missing a cargoQueue function – where you can set both the payload size and concurrency. I believe it is already implemented internally, just not exposed publicly.

[aearly]

Closing in favor of #1555