question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Tuner refactoring

See original GitHub issue

Now tuner uses metrics that not compatible with composer metrics. Also it has a monolith structure.

What should be done:

  • Union metrics for composer and tuner
  • Make tuner more flexible using decomposition
  • Implement self._objective as separate module
  • Refactor view of model parameters. Now they become too complicated to store them into dict (see #862)

UPD (from @gkirgizov) Additional subtasks:

  • HyperOpt.get_metric_value seems to duplicate logic of PipelineObjectiveEvaluate that’s concerned with how to validate the model – so it’s better to use it instead.
  • Abstract Tuner to arbitrary Graphs. The only place where the specifics of Pipeline are required – is for evaluation of objective. But, I think, currently this can be encapsualted with Objective/ObjectiveEvaluate classes.

Regarding 1st and 3rd points by Valera, possibly Objective class is useful here.

Issue Analytics

  • State:open
  • Created a year ago
  • Comments:7

github_iconTop GitHub Comments

1reaction
nicl-nnocommented, Jul 27, 2022

Наверное единственный случай, который приходит в голову - когда у композера несколько критериев, а для тюнера актуален только один. Но это можно на стороне тюнера обрабатывать.

0reactions
Dreamlonecommented, Aug 8, 2022

у нас есть sequential тюнер, который нигде, кроме теста не используется

Это не совсем так. Последовательный тюнер имеет важную особенность: он может настраивать отдельные узлы, а не пайплайны целиком. Такая функциональность например нужна при локальном анализе чувствительности, который реализован в фреймворке версии ещё Иры. Если решите от последовательного избавляться, то стоит вынести эту функциональность в отдельную сущность

Read more comments on GitHub >

github_iconTop Results From Across the Web

Hybrid Tuner Refactoring, phase 3 [LWN.net]
Phase three of my hybrid tuner refactoring work deals with the "tuner-simple" and "dvb-pll" tuner modules. There are a number of "simple", four...
Read more >
Refactoring and automated performance tuning of ...
Refactoring and automated performance tuning of computational chemistry application ... One is to refactor the codes so that it is easier to optimize...
Read more >
PPO Tuner on NNI - Neural Network Intelligence
This is a tuner geared for NNI's Neural Architecture Search (NAS) interface. ... result: NOTE: we are refactoring this example to the latest...
Read more >
Refactoring for introducing and tuning ... - Wiley Online Library
Summary This paper presents semi-automatic software refactorings to introduce and tune structured parallelism in sequential Erlang code, ...
Read more >
'Re: [linux-dvb] [RFC] Hybrid tuner refactoring, phase 1' - MARC
List: linux-video Subject: Re: [linux-dvb] [RFC] Hybrid tuner refactoring, ... I've been working on refactoring the analog tuner.ko \ > > module, ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found