clicking 'Re-run all jobs' in GHA kicks off workflow, but marks tests as passing with 'Run Finished' but tests are not triggered

Hello!

I am seeing behavior similar to Tests not ran: Getting “Run finished” immediately when re-running tests #147 where clicking ‘Re-run all jobs’ in Github Actions kicks off a workflow, but marks all Cypress tests as passing with ‘Run Finished’ but tests are not triggered.

Initial run details:

• runUrl for initial run with force fail test: https://dashboard.cypress.io/projects/hxd1hz/runs/2983
• force-failed tests: 1

Re-run details:

• runUrl for re-run: https://dashboard.cypress.io/projects/hxd1hz/runs/2983
• totalFailed: 0

Additional notes: I’m not finding jobId in the logs and see that ciBuildId is either set to "" or '-'.

GHA re-run debug log:

====================================================================================================

  (Run Starting)

  cypress:server:run formatting Node version. { version: '16.14.0', path: '/__t/node/16.14.0/x64/bin/node' } +392ms
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Cypress:        9.5.0                                                                          │
  │ Browser:        Chrome 98 (headless)                                                           │
  │ Node Version:   v16.14.0 (/__t/node/16.14.0/x64/bin/node)                                      │
  │ Specs:          17 found ...                                                   │
  │ Searched:       cypress/specs/regression/**/*                                                  │
  │ Params:         Tag: regression, Group: specs/regression, Parallel: true                       │
  │ Run URL:        https://dashboard.cypress.io/projects/hxd1hz/runs/2983                         │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘

  cypress:server:plugins plugin event registered? { event: 'before:run', isRegistered: false } +817ms
  cypress:server:api request to url: POST https://api.cypress.io/runs/dbef3e1c-8870-4338-9f95-d2d5708dd66e/instances with params: {"body":{"spec":null,"groupId":"specs/regression-linux-Chrome-98-b481d0ac4e","machineId":"8158b68f-7d58-4058-88c6-43deebd81200","platform":{"osCpus":[{"model":"Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz","speed":2095,"times":{"user":60520,"nice":130,"sys":22730,"idle":186370,"irq":0}},{"model":"Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz","speed":2095,"times":{"user":64970,"nice":100,"sys":25400,"idle":185190,"irq":0}}],"osName":"linux","osMemory":{"free":145342464,"total":7284850688},"osVersion":"Debian - 10.11","browserName":"Chrome","browserVersion":"98.0.4758.102"}},"headers":{"x-route-version":"5","x-cypress-run-id":"dbef3e1c-8870-4338-9f95-d2d5708dd66e","x-cypress-request-attempt":0,"x-os-name":"linux","x-cypress-version":"9.5.0"}} and token: undefined +54ms
  cypress:network:agent addRequest called { isHttps: true, href: 'https://api.cypress.io/runs/dbef3e1c-8870-4338-9f95-d2d5708dd66e/instances' } +208ms
  cypress:network:agent got family { family: 4, href: 'https://api.cypress.io/runs/dbef3e1c-8870-4338-9f95-d2d5708dd66e/instances' } +0ms
  cypress:server:api response { spec: null, instanceId: null, totalInstances: 17, claimedInstances: 17, estimatedWallClockDuration: null } +6s
  cypress:server:run final results of all runs: { startedTestsAt: undefined, endedTestsAt: undefined, totalDuration: 0, totalSuites: 0, totalTests: 0, totalFailed: 0, totalPassed: 0, totalPending: 0, totalSkipped: 0, runs: [], browserPath: 'google-chrome', browserName: 'chrome', browserVersion: '98.0.4758.102', osName: 'linux', osVersion: 'Debian - 10.11', cypressVersion: '9.5.0', runUrl: 'https://dashboard.cypress.io/projects/hxd1hz/runs/2983', config: { configFile: '***/packages/apps/vue/cypress.json', env: { codeCoverageTasksRegistered: true, CACHE_FOLDER: '/root/.cache/Cypress', INSTALL_BINARY: 0, RECORD_KEY: '1287a...03971' }, testingType: 'e2e', version: '9.5.0', baseUrl: 'https://localhost:8080/', projectId: 'hxd1hz', chromeWebSecurity: false, integrationFolder: '***/packages/apps/vue/cypress/specs', defaultCommandTimeout: 10000, reporter: 'junit', viewportWidth: 1920, viewportHeight: 1080, retries: { runMode: 3, openMode: 0 }, numTestsKeptInMemory: 0, projectRoot: '***/packages/apps/vue', projectName: 'vue', rawJson: { baseUrl: 'https://localhost:8080/', projectId: 'hxd1hz', chromeWebSecurity: false, integrationFolder: 'cypress/specs', defaultCommandTimeout: 10000, reporter: 'junit', viewportWidth: 1920, viewportHeight: 1080, retries: [Object], numTestsKeptInMemory: 15, envFile: {}, projectRoot: '***/packages/apps/vue', projectName: 'vue' }, morgan: false, isTextTerminal: true, socketId: '6pxnb', report: true, browsers: [ [Object], [Object] ], animationDistanceThreshold: 5, blockHosts: null, clientCertificates: [], component: {}, componentFolder: '***/packages/apps/vue/cypress/component', downloadsFolder: '***/packages/apps/vue/cypress/downloads', e2e: {}, execTimeout: 60000, exit: true, experimentalFetchPolyfill: false, experimentalInteractiveRunEvents: false, experimentalSessionSupport: false, experimentalSourceRewriting: false, experimentalStudio: false, fileServerFolder: '***/packages/apps/vue', fixturesFolder: '***/packages/apps/vue/cypress/fixtures', ignoreTestFiles: '*.hot-update.js', includeShadowDom: false, keystrokeDelay: 0, modifyObstructiveCode: true, pageLoadTimeout: 60000, pluginsFile: '***/packages/apps/vue/cypress/plugins/index.js', port: 39899, redirectionLimit: 20, reporterOptions: null, requestTimeout: 5000, resolvedNodePath: '/__t/node/16.14.0/x64/bin/node', resolvedNodeVersion: '16.14.0', responseTimeout: 30000, screenshotOnRunFailure: true, screenshotsFolder: '***/packages/apps/vue/cypress/screenshots', slowTestThreshold: 10000, scrollBehavior: 'top', supportFile: '***/packages/apps/vue/cypress/support/index.js', supportFolder: '***/packages/apps/vue/cypress/support', taskTimeout: 60000, testFiles: '**/*.*', trashAssetsBeforeRuns: true, userAgent: null, video: true, videoCompression: 32, videosFolder: '***/packages/apps/vue/cypress/videos', videoUploadOnPasses: true, waitForAnimations: true, watchForFileChanges: false, autoOpen: false, clientRoute: '/__/', devServerPublicPathRoute: '/__cypress/src', hosts: null, isInteractive: true, namespace: '__cypress', reporterRoute: '/__cypress/reporter', socketIoCookie: '__socket.io', socketIoRoute: '/__socket.io', xhrRoute: '/xhrs/', cypressEnv: 'production', resolved: { animationDistanceThreshold: [Object], baseUrl: [Object], blockHosts: [Object], chromeWebSecurity: [Object], clientCertificates: [Object], component: [Object], componentFolder: [Object], defaultCommandTimeout: [Object], downloadsFolder: [Object], e2e: [Object], env: [Object], execTimeout: [Object], exit: [Object], experimentalFetchPolyfill: [Object], experimentalInteractiveRunEvents: [Object], experimentalSessionSupport: [Object], experimentalSourceRewriting: [Object], experimentalStudio: [Object], fileServerFolder: [Object], fixturesFolder: [Object], ignoreTestFiles: [Object], includeShadowDom: [Object], integrationFolder: [Object], keystrokeDelay: [Object], modifyObstructiveCode: [Object], numTestsKeptInMemory: [Object], pageLoadTimeout: [Object], pluginsFile: [Object], port: [Object], projectId: [Object], redirectionLimit: [Object], reporter: [Object], reporterOptions: [Object], requestTimeout: [Object], resolvedNodePath: [Object], resolvedNodeVersion: [Object], responseTimeout: [Object], retries: [Object], screenshotOnRunFailure: [Object], screenshotsFolder: [Object], slowTestThreshold: [Object], scrollBehavior: [Object], supportFile: [Object], supportFolder: [Object], taskTimeout: [Object], testFiles: [Object], trashAssetsBeforeRuns: [Object], userAgent: [Object], video: [Object], videoCompression: [Object], videosFolder: [Object], videoUploadOnPasses: [Object], viewportHeight: [Object], viewportWidth: [Object], waitForAnimations: [Object], watchForFileChanges: [Object], browsers: [Object], hosts: [Object], isInteractive: [Object], configFile: [Object], testingType: [Object], version: [Object] }, parentTestsFolder: '***/packages/apps/vue/cypress', parentTestsFolderDisplay: 'vue/cypress', scaffoldedFiles: [ [Object] ], proxyUrl: 'http://localhost:39899', browserUrl: 'https://localhost:8080/__/', reporterUrl: 'https://localhost:8080/__cypress/reporter', xhrUrl: '__cypress/xhrs/', proxyServer: 'http://localhost:39899', state: {} }, status: 'finished' } +6s
  cypress:server:plugins plugin event registered? { event: 'after:run', isRegistered: false } +6s

====================================================================================================

  (Run Finished)

We are using Cypress 9.5.0 with the following workflow file:

name: Cypress regression tests
    runs-on: ubuntu-20.04
    container: cypress/included:9.5.0
    needs: [init]
    if: ${{ github.ref == 'refs/heads/main' || github.event.pull_request.draft == false }}
    strategy:
      fail-fast: false
      matrix:
        containers: [1, 2, 3, 4]
    steps:
      - uses: actions/checkout@v2
      - uses: ./.github/actions/dependencies
      - name: cypress
        uses: cypress-io/github-action@v2
        with:
          install: false
          parallel: true
          record: true
          start: yarn start:cypress
          wait-on: 'https://localhost:8080'
          command: yarn test:regression
          browser: chrome
          project: packages/apps/vue
        env:
          DEBUG: 'cypress:*'
          NODE_TLS_REJECT_UNAUTHORIZED: 0
          CYPRESS_INSTALL_BINARY: 0
          CYPRESS_RECORD_KEY: ${{ secrets.CYPRESS_RECORD_KEY }}
          PERCY_PARALLEL_TOTAL: 4
          PERCY_PARALLEL_NONCE: '${{ github.event_name }}-${{ github.sha }}'
          PERCY_TARGET_BRANCH: 'develop'
          PERCY_BRANCH: ${{ github.head_ref }}
          GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}

yarn test:regression script details: cypress run --group specs/regression --spec 'cypress/specs/regression/**/*' --ci-build-id $GIT_COMMIT-$BUILD_NUMBER --config-file cypress.json --tag 'regression' --browser chrome --parallel --record"

We noticed ‘Re-run all jobs’ failing to trigger tests roughly about a month ago. I’ve been sporadically trying to debug the issue since, but am at a loss. ‘Re-run all jobs’ worked prior to this. Any help or insight on how to resolve this would be greatly appreciated!

[robertguss]

@mmsjd awesome! glad it worked and my pleasure.

[mmsjd]

Hello! Happy to report using cutom-build-id solution worked. Thank you so much for all your help.