Ensure release artifacts are passing some basic tests like Happy Path tests before pushing chectl release binaries
See original GitHub issueIs your enhancement related to a problem? Please describe.
che-plugin-registry released image had invalid data in it. But all ‘release process’ was successful as jobs being successfully terminated.
But the resulting latest
release was failing.
We should prevent to make publicly available a release if it’s not passing some basic tests.
Describe the solution you’d like
Before pushing chectl release artifacts, ensure that the tagged Che version is passing Happy Path tests. If it does not pass, we could hold the chectl release and then end-users don’t see a new version available.
Describe alternatives you’ve considered
Of course, each component could have its own checks as post-release check but a end-to-end check would ensure that something basic is still working.
Additional context
Issue Analytics
- State:
- Created 3 years ago
- Comments:15 (15 by maintainers)
Top Results From Across the Web
Testing
Writing tests is an essential part of design and implementation. The most important skill in writing tests is to determine what to test,...
Read more >Delft Students on Software Architecture – DESOSA 2019
running JUnit tests to test the code before a PR is ... After these steps, the production engineer ensures that the release notes...
Read more >CS362 Final Flashcards - Quizlet
What is software verification? Testing falls into this phase of software development. Phase to ensure that the actual implementation meets the requirements.
Read more >Search OpenShift CI
[scolange@scolange openshift-tests-private]$ oc adm top pod olm-operator-9bc846cf6-cfvfl -o yaml Error: unknown shorthand flag: 'o' in -o [jzhang@dhcp-140-36 ...
Read more >The effect of Functional Electrical Stimulation on abdominal ...
tests. The two groups were compared at baseline to ensure that they were analogous. To ... the WHO released a system of documenting...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
It’s possible to run Happy path tests and E2E Devfile tests against already released version of Eclipse Che even now by building the next Jenkins job with proper set of parameters, if chectl binary of released version is existed https://main-jenkins-csb-crwqe.apps.ocp4.prod.psi.redhat.com/job/Che/job/e2e/job/minikube/job/basic/job/eclipse-che/
@tolusha yes