[BUG] "expect(element).toHaveScreenshot" method doesn't auto-retry screenshot till the timeout, it fails after first try

Context:

• Playwright Version: 1.22.1
• Operating System: Mac
• Node.js version: 14.4
• Browser: Chromium

Using the code from docs example which is below, expect timeout is set to 15 seconds but in fact I see that “expect(element).toHaveScreenshot” method fails after first try of comparison, it doesn’t re-try screenshot.

const locator = page.locator('button');
await expect(locator).toHaveScreenshot();

[VsKatshuma]

In our use case, we would very much like a matcher that retakes a screenshot until it matches the snapshot. I really hope that something like what @aslushnikov mentioned in https://github.com/microsoft/playwright/issues/14226#issuecomment-1131777539 is implemented in playwright. (polling a screenshot)

Would you be able to confirm if such functionality is underway, or was this just a comment with little weight behind it? If no such method will be available in the near future, we will know to explore an alternative solution.

[philib]

In our use case, we would very much like a matcher that retakes a screenshot until it matches the snapshot. I really hope that something like what @aslushnikov mentioned in #14226 (comment) is implemented in playwright. (polling a screenshot)

Would you be able to confirm if such functionality is underway, or was this just a comment with little weight behind it? If no such method will be available in the near future, we will know to explore an alternative solution.

We also stumbled across this problem and expected the feature to behave like @VsKathsuma described it. Would that be a bigger change?