[question] Service API low recommended parallelism
See original GitHub issueService API allows to run parallel trials. However, when reaching the threashold of acceptable number get_next_trial
throws a ValueError
. I was wondering if this could be changed for some more specific exception or returning None
?
I want to avoid using enforce_sequential_optimization=False
and get_recommended_max_parallelism
is returning me a small parallel setting on default ([(5, 5), (-1, 3)]
).
Any tips to either increase this number for parallel evaluations (still sequential batch evaluations)?
Issue Analytics
- State:
- Created 4 years ago
- Comments:8 (7 by maintainers)
Top Results From Across the Web
Limiting parallelism when external APIs are invoked (i.e. ...
We are applying a groupby operation to a pyspark.sql.Dataframe and then on each group train a single model for mlflow.
Read more >Service protection API limits - Power Apps
Most scenarios will be fastest sending single requests with a high degree of parallelism. If you feel batch size might improve performance, it ......
Read more >Top 5 Concurrency Interview Questions for Software ...
Today, we'll cover teach you the basics of concurrency and review the 5 most asked concurrency questions you'll find at a concurrency interview....
Read more >CUDA Dynamic Parallelism API and Principles
Any program that depends on specific grids or thread blocks executing concurrently is ill-formed. Once created, a device stream can be used by ......
Read more >When should I use parallelism? [closed]
When should I use it? are there any best practices? Is it just a waste of time in most cases? Is it suitable...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
@casassg, we will definitely consider adding an early stopping check and see if we can develop a good heuristic for it, thank you for the suggestion!
Re: following the conversation, I will definitely describe the changes in the changelog of the repo, but maybe @kkashin has more ideas on how we could keep you in the loop!
Making this an “enhancement” and a “wishlist” item for now, since early-stopping heuristic will be part of our more long-term plan and the question part of the issue was answered.