Why is cypress run different from cypress open with the same browser and the same configuration?

Current behavior:

cypress open and cypress run do not provide the same tests results.

Configuration is the very same, --browser chrome is used in both cases. Upon running the tests with cypress run, I really am running the chrome browser, as I do when I run cypress open.

Desired behavior:

cypress open and cypress run provide the same tests results.

Steps to reproduce: (app code and test code)

How to reproduce:

1. Clone the repo (don’t worry, it’s small)

git clone --branch setup-build-definition https://github.com/shopozor/consumer-frontend
cd consumer-frontend
git submodule init
git submodule update

1. download the npm packages

yarn

1. start app

yarn start:dev

1. run cypress run

yarn cypress:integration

Here I have errors. 5. run cypress open

yarn cypress:open

Make sure you select Chrome 77. Run all the tests. There I have no errors (except one that is normal because I have a test where I expect true to be false).

Versions

Tested on ubuntu 18.04 and Windows 10. Cypress version 3.4.1. Browser: Chrome 77

[gkgeorgiev]

Unfortunately there are too many of those “misuse” cases, which could speak of design flows, cos a well defined API shouldn’t allow “misuse”.

[zadigus]

All the tests are green. It was really a misuse of Cypress.