question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

fix/upgrade integration tests

See original GitHub issue
  • tests sometimes pass despite introducing breaking changes
    • The main reason was having introduced a gyp lib that needed sudo permissions breaking the cml service inside the CML aws image managed by our terraform provider
  • should use external repo & send-check to
    • avoid spamming CML with comments
    • avoid too many token permissions

We need:

  • Integration tests that take the whole picture
    • testbot should do the trick however the CML image is picking from master

Issue Analytics

  • State:open
  • Created 2 years ago
  • Reactions:2
  • Comments:6 (6 by maintainers)

github_iconTop GitHub Comments

1reaction
DavidGOrtegacommented, May 19, 2021

No, what I say is that despite that we are testing everything when we launch a cloud runner it is going to use “live” cml not “dev”, hence we are not going to notice those issues and testing with cloud runners is unsecure

0reactions
0x2b3bfa0commented, Aug 22, 2021

Not necessarily <kbd>blocked</kbd> by https://github.com/iterative/cml/issues/645 unless we plan to send GitHub checks between repositories. In fact, I would prefer to avoid that approach and resort to our jest tests instead to verify that the triggered actions have altered the target repository status in the expected way.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Improve cleanup to fix upgrade tests
Improve cleanup to fix upgrade tests · k8ssandra/k8ssandra@36d2884. ... Adds upgrade integration tests and upgrades cass-operator to v1.7.1 #706.
Read more >
Integration tests not working in Stash | Bitbucket Server - Jira
It seems like integration tests are broken from version 2.5.0 of Stash and since Stash source doesn't use them for its testing it...
Read more >
release_notes.txt
... runs for xenial and bionic + run focal lxd integration tests * d/control: ... service - integration test improvements: + upgrade-test: fix...
Read more >
GitHub integration - Snyk User Docs
Used to create fix / upgrade PRs in the monitored repos. Write or higher. Snyk tests on pull requests - initial configuration. Used...
Read more >
Confluent Platform Component Changelogs
PR-9323 - KAFKA-10514: Fix unit test for state directory cleanup ... PR-384 - KAFKA-2714: Added integration tests for exceptional cases in fetching ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found