Overcome Cloudflare's blocking: Please turn JavaScript on and reload the page.

Steps to reproduce

Tell us about your environment:

• Puppeteer version: 8.0.0
• Platform / OS version: Ubuntu 20.04 LTS
• URLs (if applicable):
• Node.js version: v10.21.0

What steps will reproduce the problem?

    const response = await page.goto(`https://finviz.com/news.ashx`, {
      waitUntil: 'networkidle0'
    });
    console.log(await page.content());

What is the expected result?

Get normal page

What happens instead?

Got,

Please turn JavaScript on and reload the page
Please enable Cookies and reload the page.
This process is automatic. Your browser will redirect to your requested content shortly.
Please allow up to 5 seconds…

            DDoS protection by <a rel="noopener noreferrer" href="https://www.cloudflare.com/5xx-error-landing/" target="_blank">Cloudflare</a>

The url has been working fine for ages, until it broke just a day or two before.

Any way to by-pass it? Thx

[mrceperka]

https://www.npmjs.com/package/puppeteer-extra-plugin-stealth might help… 🤞

[suntong]

Thanks a lot @mrceperka for sharing that well-kept secret, really appreciate it!!! Horay!