FATAL ERROR: v8::FromJust Maybe value is Nothing.

We have this job set up that normally works without problems. Every 10 minutes it checks whether any rules are expired and removes the expired ones.

However, seemingly randomly every 1-2 days, the job exits with the following error:

FATAL ERROR: v8::FromJust Maybe value is Nothing.
[2021-09-07T08:30:36.060Z] [error]: Worker for job "delete-expired" had an error
 1: 0xa24ed0 node::Abort() [node]
 2: 0x966115 node::FatalError(char const*, char const*) [node]
 3: 0xb9a9fa v8::Utils::ReportApiFailure(char const*, char const*) [node]
 4: 0xa286ed node::fs::FileHandle::CloseReq::Resolve() [node]
 5: 0xa28849  [node]
 6: 0x139ca5d  [node]
 7: 0x13a10b6  [node]
 8: 0x13b3e45  [node]
 9: 0x13a19e8 uv_run [node]
10: 0xadd343 node::worker::Worker::Run() [node]
11: 0xadddd8  [node]
12: 0x7fc31a7cf609  [/lib/x86_64-linux-gnu/libpthread.so.0]
13: 0x7fc31a6f6293 clone [/lib/x86_64-linux-gnu/libc.so.6]
Aborted (core dumped)

I have no idea how to go into debugging this but I assume it is an issue with the bree package core files.

The worker itself:

import { knex } from '../app/utils/connection.js';
import { parentPort } from 'worker_threads';
import { CalculatedPrice as CalculatedPriceModel } from '../app/models/index.js';
import { Cache, CalculatedPrice } from '../app/controllers/index.js'
import { getDate } from '../app/utils/date.js';

(async () => {
    // select all data that expired
    const expiredPrices = await knex('calculated_price').select('contact_id', 'sku').where('ending_date', '<', getDate()).then();
    parentPort.postMessage(JSON.stringify(expiredPrices));

    if (expiredPrices.length !== 0) {
        const expiredKeys = [];
        for (let i=0; i<expiredPrices.length; i++) {
            const { contact_id, sku } = expiredPrices[i]
            expiredKeys.push(`${contact_id}_${sku}`);
        }

        const uniqueExpiredKeys = Array.from(new Set(expiredKeys));
        // delete all that data from calculated_price
        const recalculatePairs = uniqueExpiredKeys.map((key) => key.split('_'));
        parentPort.postMessage(recalculatePairs);
        await knex('calculated_price').whereIn(['contact_id', 'sku'], recalculatePairs).del();
        parentPort.postMessage('Deleted data from calculated_price')

        // recalculate
        const calculationPromises = [];
        for (let i=0; i<expiredPrices.length; i++) {
            const { contact_id, sku } = expiredPrices[i];
            calculationPromises.push(CalculatedPrice.calculatePriceUsingSku(contact_id, sku));
        }
        await Promise.all(calculationPromises);
        parentPort.postMessage('Recalculated')
        // delete from cache or just rewrite
        parentPort.postMessage(expiredKeys);
        await Cache.deleteCachedCalculatedRules(expiredKeys);
        parentPort.postMessage('Deleted from cache')
        // add in cache
        await Cache.setCalculatedPricesInCache(recalculatePairs);
        parentPort.postMessage('Added to cache')
    }

    process.exit(0);
})();

Any help how this could be debugged?

[shadowgate15]

@climba03003 Let us know if it works so we can have that documented here.

[climba03003]

Just an idea, when I connect mongodb inside a worker but not closing the connection properly before exit. It will throw me a core error about stream.

I assume knex using sqlite will result the same if not properly closing the fs stream?