question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[question] Service API low recommended parallelism

See original GitHub issue

Service API allows to run parallel trials. However, when reaching the threashold of acceptable number get_next_trial throws a ValueError. I was wondering if this could be changed for some more specific exception or returning None?

I want to avoid using enforce_sequential_optimization=False and get_recommended_max_parallelism is returning me a small parallel setting on default ([(5, 5), (-1, 3)]).

Any tips to either increase this number for parallel evaluations (still sequential batch evaluations)?

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:8 (7 by maintainers)

github_iconTop GitHub Comments

2reactions
lena-kashtelyancommented, Nov 19, 2019

@casassg, we will definitely consider adding an early stopping check and see if we can develop a good heuristic for it, thank you for the suggestion!

Re: following the conversation, I will definitely describe the changes in the changelog of the repo, but maybe @kkashin has more ideas on how we could keep you in the loop!

1reaction
lena-kashtelyancommented, Dec 4, 2019

Making this an “enhancement” and a “wishlist” item for now, since early-stopping heuristic will be part of our more long-term plan and the question part of the issue was answered.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Limiting parallelism when external APIs are invoked (i.e. ...
We are applying a groupby operation to a pyspark.sql.Dataframe and then on each group train a single model for mlflow.
Read more >
Service protection API limits - Power Apps
Most scenarios will be fastest sending single requests with a high degree of parallelism. If you feel batch size might improve performance, it ......
Read more >
Top 5 Concurrency Interview Questions for Software ...
Today, we'll cover teach you the basics of concurrency and review the 5 most asked concurrency questions you'll find at a concurrency interview....
Read more >
CUDA Dynamic Parallelism API and Principles
Any program that depends on specific grids or thread blocks executing concurrently is ill-formed. Once created, a device stream can be used by ......
Read more >
When should I use parallelism? [closed]
When should I use it? are there any best practices? Is it just a waste of time in most cases? Is it suitable...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found