[BUG] Allure reporter screenDiff plugin doesn't work with Playwright version higher than 1.20.2

Context:

• Playwright Version: 1.21.1
• Operating System: Windows and Mac
• Node.js version: v16.14.2
• Browser: any
• Extra: “allure-playwright”: “^2.0.0-beta.16”, “allure-commandline”: “^2.17.2”

Hi guys!

Since moving from version 1.20.2 to 1.21.1 my allure reports broke and screenDiff plugin for allure report stopped working. On version 1.20.2 everything was working fine out of the box. Now it doesn’t. I have tried to switch between versions of all packages (allure-commandline, allure-playwright, @playwright/test) and identified that the problem is @playwright/test

My playwright.config.js contains this:

• reporter: [[‘list’], [‘allure-playwright’]],

My package.json has next dependencies:

• “@playwright/test”: “^1.20.2”,
• “allure-commandline”: “^2.17.2”,
• “allure-playwright”: “^2.0.0-beta.16”,
• “jest-expect-message”: “^1.0.2”

My test: test('Visual comparison of winners page @visual-regression', async ({page}) => { await page.goto('/pages/winners', {timeout: 15000, waitUntil: 'networkidle'}); expect(await page.screenshot({fullPage: true})).toMatchSnapshot(); });

Running allure report with next command:

• npx allure generate ./allure-results --clean && npx allure open ./allure-report

Here is screenshot of screenDiff on Playwright version 1.20.2 :

Here is screenshot for Playwright 1.21.1 :

I can provide more info if you need, but reproducing this is very easy. Just run a basic visual-comparison test with allure reporter. To see the difference, first run your test on Playwright 1.20.2, and then on Playwright 1.21.1

Thank you!

[ivan-krupskyi]

@mxschmitt, if you add this, than it would work as expected (I have tested it):

[pavelfeldman]

I’ll close this issue because I believe it is being followed up on in the allure repo!