question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

parallel task/function on the same host

See original GitHub issue

Hi with Fabric v1.14 If I want to have parallel execution of a function on the same/single host, is that possible to use @parallel ? I already tested these two options:

  • if I use threading option, the shared env variable can be written by different threads
  • if I use pool option, it will stuck on the run command , however, local works fine

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:5 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
davidjmemmettcommented, Mar 3, 2021

Without wanting to be rude or mean, I think everything you’re wanting to do is taken care of in the documentation. If there is an issue you’d like to raise, please feel free re-open this ticket.

Cheers, David

0reactions
arabnejadcommented, Mar 6, 2021

Hi @davidjmemmett

just one more question, due to some develop limitation, I can not use other external library is there any version of Fabric support multi-process execution of run command, i.e., assume you have

def fun1(.....):
    ...
    fabric.run(.....)
    ...

and then you assign this function to process worker in multiprocessing.pool

   P = multiprocessing.Pool(....)
   P.apply_async(func=fun1,.....)

everything works well, until we reach to fabric.run command and code hangs there in all concurrent process

Read more comments on GitHub >

github_iconTop Results From Across the Web

Task parallelism
Task parallelism is a form of parallelization of computer code across multiple processors in parallel computing environments. Task parallelism focuses on ...
Read more >
azure functions - How many parallel tasks can do with ...
If the FUNCTIONS WORKER PROCESS COUNT is set to 10, each host instance will perform 10 individual functions at the same time.
Read more >
Tasks and Parallelism: The New Wave of Multithreading
Parallel programming covers a wider spectrum and refers to the ability to have multiple tasks going on concurrently. Concurrent does not ...
Read more >
Task-based asynchronous programming - .NET
The term task parallelism refers to one or more independent tasks running concurrently. Tasks provide two primary benefits:.
Read more >
Parallel execution
This document describes Fabric's options for running tasks on multiple hosts in parallel, via per-task decorators and/or global command-line switches. What it ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found