page.waitForNavigation hangs forever

Steps to reproduce

Tell us about your environment:

• Puppeteer version: puppeteer@2.0.0
• Platform / OS version: MacOS Catalina, 10.15.3 (19D76)
• URLs (if applicable): https://www.escentual.com/catalogsearch/result/?q=face
• Node.js version: v12.13.0

What steps will reproduce the problem? Full code as follows, just trying to go to 10 pages by clicking the next link on each page.

const pptr = require('puppeteer');

async function main() {
  const br = await pptr.launch({headless: false, defaultViewport: null});
  const page = await br.newPage();

  await page.goto(
    'https://www.escentual.com/catalogsearch/result/?q=face',
    {waitUntil: 'networkidle2'}
  );

  for (var i=0; i<10; ++i) {
    await Promise.all([
      page.waitForNavigation({waitUntil: 'load', timeout: 100000}),
      page.click('#adj-nav-container > div.category-products > div.toolbar > div > div.amount > div > ol > li.next > a'),
    ]);
    console.log(`waited, url=${page.url()}`);
  }
  await br.close();
}

main();

What is the expected result? I was expecting the above code could go to 10 pages by clicking the next link on each page.

What happens instead? However, the above code gets stuck at 2nd page forever, waiting waitForNavigation to finish forever.

[ecolss]

If I remove or replace the page.waitForNavigation in the above code, it works. So I thought maybe there is no navigation event happening at all after the click?

But this speculation doesn’t make sense, since according to the waitForNavigation documentation, if the page navigates to a new url, it should have a navigation event, right?

[stale[bot]]

We are closing this issue. If the issue still persists in the latest version of Puppeteer, please reopen the issue and update the description. We will try our best to accomodate it!