Keep going with independent tasks
See original GitHub issueWhen a WDL task fails (run via AGC), I’ve observed that all other tasks are killed. I’d like miniwdl
to execute as many tasks as possible until there are no more tasks that are independent of the failure(s). See snakemake’s --keep-going
option and Nextflow’s errorStrategy
. This would allow me to complete as many tasks as possible, so that the next time I re-run the workflow while caching tasks, I’ll be closer both to completion as well as having the task that failed start sooner (to see if it works this time).
Issue Analytics
- State:
- Created a year ago
- Comments:5 (2 by maintainers)
Top Results From Across the Web
Independent Tasks - ALL-ED
Independent tasks require students to develop, practice, test, and retrieve targeted skills, knowledge, and understanding.
Read more >110 Independent tasks ideas | work boxes, teacch ... - Pinterest
Mar 5, 2020 - Explore Denise Keilman Morario's board "independent tasks" on Pinterest. See more ideas about work boxes, teacch tasks, teacch.
Read more >The Dos and Don'ts of Independent Work - The Autism Helper
Click on the pictures for links to independent task ideas and supplies! · Don't – Change Routines and Expectations Too Fast. If you...
Read more >How to Keep Students On Task When Working Independently
I'm going to fill you in with my favorite tips to keep students on task when working independently so that you can experience...
Read more >How To Improve Your Ability To Work Independently - Indeed
Working at your own pace: You can set the pace of working on assignments and tasks while working independently. For example, you can...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Thanks @mlin this is super helpful and thank you for your patience. I’m really enjoying using miniwdl so hopefully these questions are not seen as a criticism but a desire to understand, and contribute back in some small part.
There’s a config option
[scheduler] fail_fast = false
/ envMINIWDL__SCHEDULER__FAIL_FAST=false
that should do this. I don’t think we have a test case for it with AWS specifically, but that scheduler logic is “above” the container backend. Let me know if it doesn’t work.