question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Tests are non-deterministic

See original GitHub issue

We hit an unexpected test failure in test_directed_input. The error was that one of the source graphs was disconnected. This was pretty unlikely, given the G(n,p) parameters, but it can happen, and because the tests do not fix np.random.seed() and random.seed(), it will probably pop up randomly from time to time and force us to restart Travis jobs.

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:5

github_iconTop GitHub Comments

1reaction
sdmccabecommented, Jun 20, 2019

We don’t actually mention running the tests locally in CONTRIBUTING, and any Travis failures can be addressed by us.

0reactions
sdmccabecommented, Jun 24, 2019

#240 will deal with the density concern. Otherwise, we’ll close this for now.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Testing: deterministic or non-deterministic?
Both. Deterministic and nondeterministic tests have different use cases and different values to your suite. Generally nondeterministic can ...
Read more >
Non-determinism in tests - Enterprise Craftsmanship
Non-determinism basically stands for flickering tests. These are tests that pass most of the time but fail once in a while and then...
Read more >
Seven Recommendations for Testing in a Non-Deterministic ...
Testing for non-deterministic defects often involves the performance of specialty engineering types of testing. Before you can test for the ...
Read more >
Testing non-deterministic code - HitchDev
Non-deterministic code is code which can produce different outputs even when it is given the same inputs. For example: a program that is...
Read more >
Nondeterminism in Unit Testing - Stack Overflow
It seems that in many unit tests, the values that parameterize the test are either baked in to the test themselves, or declared...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found