Tests are non-deterministic
See original GitHub issueWe hit an unexpected test failure in test_directed_input. The error was that one of the source graphs was disconnected. This was pretty unlikely, given the G(n,p) parameters, but it can happen, and because the tests do not fix np.random.seed() and random.seed(), it will probably pop up randomly from time to time and force us to restart Travis jobs.
Issue Analytics
- State:
- Created 4 years ago
- Comments:5
Top Results From Across the Web
Testing: deterministic or non-deterministic?
Both. Deterministic and nondeterministic tests have different use cases and different values to your suite. Generally nondeterministic can ...
Read more >Non-determinism in tests - Enterprise Craftsmanship
Non-determinism basically stands for flickering tests. These are tests that pass most of the time but fail once in a while and then...
Read more >Seven Recommendations for Testing in a Non-Deterministic ...
Testing for non-deterministic defects often involves the performance of specialty engineering types of testing. Before you can test for the ...
Read more >Testing non-deterministic code - HitchDev
Non-deterministic code is code which can produce different outputs even when it is given the same inputs. For example: a program that is...
Read more >Nondeterminism in Unit Testing - Stack Overflow
It seems that in many unit tests, the values that parameterize the test are either baked in to the test themselves, or declared...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found

We don’t actually mention running the tests locally in CONTRIBUTING, and any Travis failures can be addressed by us.
#240 will deal with the density concern. Otherwise, we’ll close this for now.