How to get all cookies?

Hi yujiosaka,

I’m trying to retrieve all the cookies on a page (1st and third party cookies).

The default result.cookies only contains 1st party cookies:

onSuccess: (result => {
    console.log(result.cookies);
}),

There is a way with Puppeteer to get all cookies, including third party with the await page._client.send('Network.getAllCookies')); method.

So I’m trying to use that with the crawler, however the onSuccess method only returns result which doesn’t contain a reference to Puppeteer’s page object.

Do you know where I can call the async page._client.send('Network.getAllCookies')); method so I can retrieve all cookies (1st/third) on every crawled page?

Many thanks

[Zeikko]

With headless-chrome-crawlerversion 1.8.0 you can use this customCrawl function to get all cookies:

async function customCrawl(page, crawl) {
  const result = await crawl();
  const cookies = await page._client.send('Network.getAllCookies');
  result.cookies = cookies.cookies;
  return result;
}

[BubuAnabelas]

@pandacoder

Actually page is exposed through the newpage event and from there you could access browser or target. But as it’s currently exposed it makes it difficult to get/set cookies correctly. I agree that headless-chrome-crawler should be well focused but it needs to be extendable enough to be able to do these kind of things.