cypress open and cypress run result is not same

Current behavior

When i use cypress open and run all test cases, all cases passed.

But if i use cypress run, some of it will not pass.

test with cypress open, everything is ok

Desired behavior

cypress open and cypress run command get the same test result.

Test code to reproduce

Clone code

git clone https://github.com/DouyinFE/semi-design
yarn bootstrap
yarn start

Cypress open

yarn test:cy

Cypress run

./node_modules/.bin/cypress run

Cypress Version

9.5.2

Other

No response

[CaiqueCoelho]

@shijiatongxue I think this is not necessarily a problem. Because with Cypress open I saw you are running the tests with Chrome browser, but with Cypress run the default is Electron. Can you send us what is the error message you are getting in these failed tests using cypress run?

[davidmunechika]

Sorry for the delayed response! If possible, I would suggest narrowing down the variables involved here so that we can clearly focus on what is causing the issue. This would help us out a lot.

• Narrow it down to a single failing simple test case
• Remove as much extra config as possible while still having the test failures discrepancies.

After that I would compare the Test Runner command log within each run to see if there is some timing variability between the 2 runs.