Error: Page crashed!

Hello,

I’m using yout project, and since yesterday i’m getting this error:

UnhandledPromiseRejectionWarning: Error: Page crashed! at Page._onTargetCrashed (C:\Users\User01\Documents\linkedin-profile-scraper\node_modules\puppeteer\lib\Page.js:213:24) at CDPSession.<anonymous> (C:\Users\User01\Documents\linkedin-profile-scraper\node_modules\puppeteer\lib\Page.js:122:56) at CDPSession.emit (events.js:311:20) at CDPSession._onMessage (C:\Users\User01\Documents\linkedin-profile-scraper\node_modules\puppeteer\lib\Connection.js:200:12) at Connection._onMessage (C:\Users\User01\Documents\linkedin-profile-scraper\node_modules\puppeteer\lib\Connection.js:112:17) at WebSocket.<anonymous> (C:\Users\User01\Documents\linkedin-profile-scraper\node_modules\puppeteer\lib\WebSocketTransport.js:44:24) at WebSocket.onMessage (C:\Users\User01\Documents\linkedin-profile-scraper\node_modules\ws\lib\event-target.js:120:16) at WebSocket.emit (events.js:311:20) at Receiver.receiverOnMessage (C:\Users\User01\Documents\linkedin-profile-scraper\node_modules\ws\lib\websocket.js:789:20) at Receiver.emit (events.js:311:20) (node:2656) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). To terminate the node process on unhandled promise rejection, use the CLI flag --unhandled-rejections=strict (see https://nodejs.org/api/cli.html#cli_unhandled_rejections_mode). (rejection id: 1) (node:2656) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.

Are you planning to fix this?

[jvandenaardweg]

Feel free to send in a PR to block these kind of requests that are not needed for LinkedIn to work properly. I believe more could be blocked to speed up the crawling.

You can block requests here: https://github.com/jvandenaardweg/linkedin-profile-scraper/blob/master/scraper/linkedin.js#L49

req.url() has the URL of the resource

[jvandenaardweg]

@mrkrisjack i’ve got a PR ready (https://github.com/jvandenaardweg/linkedin-profile-scraper/pull/9) which seems to fix the issue. The problem seemed to be the blocking of stylesheet resources.

Can you pull the changes from the master branch, do a npm install, and then try again?