question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Hypothesis phase settings

See original GitHub issue

Overview

Expose hypothesis phase settings via the config file and (maybe) disable shrinking by default.

Specification

Add the following values to the default configuration.

hypothesis:
  phases:
    explicit: true
    reuse: true
    generate: true
    target: true
    shrink: false

There is a slight complexity here because this deviates from how hypothesis handles this setting natively. But we have to build the enum regardless, so this feels like a good approach imo.

re: disabling shrinking by default - this is the reason I need this setting exposed. As soon as shrinking begins, the max_examples value is now ignored… if you’re using sufficiently complex strategies or a state machine, the process can be very slow. There is definitely a value in producing a minimal example, but given the environment we’re using hypothesis in I’m not sure if this behavior is more often good or harmful. cc @fubuloubu - any thoughts?

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:5 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
fubuloubucommented, Jun 9, 2020

I meant more to explore the logic of similar shrinking strategies (like strings) and try to adapt it so it’s fast to shrink

0reactions
fubuloubucommented, Jun 29, 2020

It’d probably make more sense to do a CLI flag in that case

Read more comments on GitHub >

github_iconTop Results From Across the Web

Settings — Hypothesis 6.61.0 documentation - Read the Docs
To see what's going on while Hypothesis runs your tests, you can turn up the verbosity setting. ... The four levels are quiet,...
Read more >
Hypothesis testing phase - FutureLearn
The discovery based (hypothesis generating) experiment is the first step of the scientific study. Further studies should be performed to validate the discovery ......
Read more >
hypothesis/settings.rst at master - GitHub
Hypothesis divides tests into logically distinct phases: ... The phases setting provides you with fine grained control over which of these run, with...
Read more >
Hypothesis Testing - NEDARC
Five Steps in Hypothesis Testing: Specify the Null Hypothesis; Specify the Alternative Hypothesis; Set the Significance Level (a); Calculate the Test Statistic ...
Read more >
4. The Definition Phase (How to Frame Your Experiments)
Figure 4-1. “The Definition Phase” of our experimentation framework is where you frame the goal of your experiment and the hypotheses that you...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found