question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Multi-Task GP tutorial doesn't run

See original GitHub issue

The Ax Multi-Task GP tutorial (https://ax.dev/tutorials/multi_task.html) runs until the Bayesian optimization loop step 4c

runners = {
    'GP, online only': run_online_only_bo,
    'MTGP, Algorithm 1': run_mtbo,
}
iteration_objectives = {k: [] for k in runners}
iteration_constraints = {k: [] for k in runners}
for rep in range(n_reps):
    print('Running rep', rep)
    for k, r in runners.items():
        obj, con = r()
        iteration_objectives[k].append(obj)
        iteration_constraints[k].append(con)

for k, v in iteration_objectives.items():
    iteration_objectives[k] = np.array(v)
    iteration_constraints[k] = np.array(iteration_constraints[k])

At which point it fails with ValueError: status_quo is not defined for the selected trial.

Stack trace:

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-8-6f5702c98588> in <module>
      8     print('Running rep', rep)
      9     for k, r in runners.items():
---> 10         obj, con = r()
     11         iteration_objectives[k].append(obj)
     12         iteration_constraints[k].append(con)

<ipython-input-7-88fb8b2e972e> in run_mtbo()
     51             experiment=exp_multitask,
     52             data=exp_multitask.fetch_data(),
---> 53             search_space=exp_multitask.search_space,
     54         )
     55 

~/.pyenv/versions/3.7.3/envs/p3/lib/python3.7/site-packages/ax/modelbridge/factory.py in get_MTGP(experiment, data, search_space, trial_index)
    208     status_quo = experiment.trials[trial_index].status_quo
    209     if status_quo is None:
--> 210         raise ValueError("status_quo is not defined for the selected trial.")
    211     else:
    212         status_quo_features = ObservationFeatures(

ValueError: status_quo is not defined for the selected trial.

Environment:

python 3.7.3
ax-platform 0.1.6
botorch 0.1.4
gpytorch 0.3.5

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Reactions:1
  • Comments:7 (5 by maintainers)

github_iconTop GitHub Comments

2reactions
kzielnickicommented, Nov 6, 2019

Thanks @Balandat and @sdsingh, I can verify that this runs after installing gpytorch from master 🎉

1reaction
lena-kashtelyancommented, Jan 6, 2020

The tutorial now runs on latest stable versions of Ax + BoTorch!

Read more comments on GitHub >

github_iconTop Results From Across the Web

[Question] Implementing multi-output multi-task approximate GP
I am looking into implementing a model that produces multiple correlated output for multiple tasks (multi-task-multi-output - MTMO).
Read more >
Multi-task Gaussian Process Prediction
In this paper we investigate multi-task learning in the context of Gaussian Pro- cesses (GP). We propose a model that learns a shared...
Read more >
ModelList (Multi-Output) GP Regression
This notebook demonstrates how to wrap independent GP models into a convenient Multi-Output GP model using a ModelList. Unlike in the Multitask case, ......
Read more >
MAGMA: inference and prediction using multi-task Gaussian ...
A novel multi-task Gaussian process (GP) framework is proposed, by using ... Section 7 draws perspectives for future work, and we defer some ......
Read more >
Source code for botorch.models.multitask
Multi-task exact GP that uses a simple ICM kernel. ... WARNING: It currently does not support different noise levels for the different tasks....
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found