EMFILE: too many open files

I’m running a job every second that instantiates a class, like so

const RedisService = require('../../services/redis-service');
...
const redis = new RedisService()

This job runs for awhile and then eventually goes into a fail loop with the error

EMFILE: too many open files

and points to ...services/redis-service.js as the open that exceeded whatever ulimit -n must be on my machine. I know that there are packages like graceful-fs that might be able to solve this problem, but is this just because I’m using Bree incorrectly? Is there a proper way to close the files that a job opens when it is run by Bree?

[shadowgate15]

@alvin30595 I would suggest using the workerMessageHandler and do the logging work on the main process. Worker threads and logging is pretty difficult.

[r00b]

Specifically I believe the issue was that as Node worker threads exited they did not necessarily flush their file streams, thus when the number of open file streams exceeded ulimit, the parent process crashed. I think.