question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

How does the sampler (tpe) handle the different trial states?

See original GitHub issue

Hi, a trial can have different states:

    RUNNING = 0
    COMPLETE = 1
    PRUNED = 2
    FAIL = 3
    WAITING = 4

When the sampler (tpe) sees these trials in a database when a new trial starts - how does it handle them? It uses completed trials to get a signal on the fitness landscape to select the next parameter set. But how does it handle FAILed, PRUNED and RUNNING trials? Does it just ignore them?

This question is connected to this item: #913

Thanks Philip

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Reactions:1
  • Comments:11 (9 by maintainers)

github_iconTop GitHub Comments

2reactions
PhilipMaycommented, Mar 27, 2020

@sile Thanks for this explanation. Now I understood.

Should we (I as a PR) put this explanation to the documentation here: https://optuna.readthedocs.io/en/latest/reference/samplers.html#optuna.samplers.TPESampler

What do you think?

1reaction
PhilipMaycommented, May 23, 2020

No. This doc is ok I think. Thanks.

Read more comments on GitHub >

github_iconTop Results From Across the Web

optuna.samplers.TPESampler - Read the Docs
Sampler using TPE (Tree-structured Parzen Estimator) algorithm. This sampler is based on independent sampling. See also BaseSampler for more details of ' ...
Read more >
Multiple Endpoints in Clinical Trials Guidance for Industry | FDA
FDA's guidance for industry E9 Statistical Principles for Clinical Trials ... All other endpoints are referred to as exploratory in this document (see ......
Read more >
Available State Samplers - Kavraki Lab
The valid state samplers use the state space samplers as a low level primitive. Typically, they generate a number of state samples using...
Read more >
Intention-to-treat concept: A review - PMC - NCBI
Moreover, end-point data will differ markedly among noncompliant, ... CPMP guideline states that for a superiority trial, the ITT analysis should be ...
Read more >
Monte Carlo method - Wikipedia
Monte Carlo methods, or Monte Carlo experiments, are a broad class of computational algorithms that rely on repeated random sampling to obtain numerical ......
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found