Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Whole actor run randomly crash

See original GitHub issue

Describe the bug Whole actor randomly crash with error:

2021-09-22T05:16:01.457Z ERROR PuppeteerCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.walmart.com/grocery/v3/api/products/16785076?itemFields=all&storeId=4064","retryCount":1,"id":"5ucFMd6AOLbVd7t"}
2021-09-22T05:16:01.458Z   Error: net::ERR_TIMED_OUT at https://www.walmart.com/grocery/v3/api/products/16785076?itemFields=all&storeId=4064
2021-09-22T05:16:01.458Z       at navigate (/home/myuser/app/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:115:23)
2021-09-22T05:16:01.459Z       at runMicrotasks (<anonymous>)
2021-09-22T05:16:01.460Z       at processTicksAndRejections (node:internal/process/task_queues:96:5)
2021-09-22T05:16:01.460Z       at async FrameManager.navigateFrame (/home/myuser/app/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:90:21)
2021-09-22T05:16:01.461Z       at async Frame.goto (/home/myuser/app/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:416:16)
2021-09-22T05:16:01.461Z       at async Page.goto (/home/myuser/app/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1149:16)
2021-09-22T05:16:01.462Z       at async PuppeteerCrawler._handleNavigation (/home/myuser/app/node_modules/apify/build/crawlers/browser_crawler.js:361:40)
2021-09-22T05:16:01.462Z       at async PuppeteerCrawler._handleRequestFunction (/home/myuser/app/node_modules/apify/build/crawlers/browser_crawler.js:316:13)
2021-09-22T05:16:01.463Z       at async PuppeteerCrawler._runTaskFunction (/home/myuser/app/node_modules/apify/build/crawlers/basic_crawler.js:431:13)
2021-09-22T05:16:01.464Z       at async AutoscaledPool._maybeRunTask (/home/myuser/app/node_modules/apify/build/autoscaling/autoscaled_pool.js:408:17)
2021-09-22T05:16:01.538Z /home/myuser/app/node_modules/puppeteer/lib/cjs/puppeteer/common/Connection.js:217
2021-09-22T05:16:01.539Z             this._callbacks.set(id, { resolve, reject, error: new Error(), method });
2021-09-22T05:16:01.540Z                                                               ^
2021-09-22T05:16:01.541Z 
2021-09-22T05:16:01.541Z Error: Protocol error (Network.setCacheDisabled): Target closed.
2021-09-22T05:16:01.542Z     at /home/myuser/app/node_modules/puppeteer/lib/cjs/puppeteer/common/Connection.js:217:63
2021-09-22T05:16:01.542Z     at new Promise (<anonymous>)
2021-09-22T05:16:01.543Z     at CDPSession.send (/home/myuser/app/node_modules/puppeteer/lib/cjs/puppeteer/common/Connection.js:216:16)
2021-09-22T05:16:01.544Z     at NetworkManager._updateProtocolCacheDisabled (/home/myuser/app/node_modules/puppeteer/lib/cjs/puppeteer/common/NetworkManager.js:187:28)
2021-09-22T05:16:01.544Z     at NetworkManager._updateProtocolRequestInterception (/home/myuser/app/node_modules/puppeteer/lib/cjs/puppeteer/common/NetworkManager.js:178:22)
2021-09-22T05:16:01.545Z     at NetworkManager.setRequestInterception (/home/myuser/app/node_modules/puppeteer/lib/cjs/puppeteer/common/NetworkManager.js:160:20)
2021-09-22T05:16:01.545Z     at Page.setRequestInterception (/home/myuser/app/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:399:52)
2021-09-22T05:16:01.546Z     at disableRequestInterception (/home/myuser/app/node_modules/apify/build/puppeteer_request_interception.js:224:16)
2021-09-22T05:16:01.547Z     at ObservableSet.onDelete (/home/myuser/app/node_modules/apify/build/puppeteer_request_interception.js:214:21)
2021-09-22T05:16:01.547Z     at ObservableSet.emit (node:events:394:28)
2021-09-22T05:16:01.805Z

Screenshot:

System information:

docker build: apify/actor-node-puppeteer-chrome:16
Node version 16.8.0
Apify SDK version 2.0.7
Puppeteer version: 10.2.0

Launch Options

launchContext.launchOptions.args = [
        '--no-sandbox',
        '--disable-web-security',
        '--enable-features=NetworkService',
        '--ignore-certificate-errors',
        '--disable-blink-features=AutomationControlled',
        '--disable-features=site-per-process',
    ];

Any idea why is it happening? Thanks!