question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Set additional slurm parameters

See original GitHub issue

Hello,

I would like to know if it’s possible to set additional slurm parameters (and how to set them), because I couldn’t find this information in the documentation.

For example, I have a few arguments that I usually set using srun, such as --account=myaccount --hint=nomultithread --distribution=block:block --exclusive, but I have no idea how to set them in submitit.

Thank you in advance for your answer!

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Reactions:1
  • Comments:6 (2 by maintainers)

github_iconTop GitHub Comments

5reactions
netw0rkf10wcommented, Sep 19, 2020

The following works:

executor.update_parameters(
    slurm_additional_parameters={
        'account': args.account,
        'hint': 'nomultithread',
        'distribution': 'block:block',
        'exclusive': True} 
)
2reactions
gwenzekcommented, Sep 18, 2020

There is some documentation in https://github.com/facebookincubator/submitit/blob/master/docs/examples.md#explained-example---initial-add-exemple-with-a-few-more-comments

It probably should be made more visible.

executor = submitit.AutoExecutor(folder=log_folder)
# Cluster specific options must be appended to the cluster name:
# Eg.: slurm partition can be specified using `slurm_partition` argument. It
# will be ignored on other clusters:
executor.update_parameters(timeout_min=4, slurm_partition="dev")

so in your case it would be:

executor.update_parameters(timeout_min=4, slurm_account="myaccount", slurm_hint="nomultithread", slurm_distribution="block:block",  slurm_exclusive=True)
Read more comments on GitHub >

github_iconTop Results From Across the Web

sbatch - Slurm Workload Manager
Restrict node selection to nodes with at least the specified number of cores per socket. See additional information under -B option above when...
Read more >
Slurm Parameter and Settings - Sigma2 documentation
Slurm Parameter and Settings . Slurm supports a multitude of different parameters. This enables you to effectively tailor your script to your need...
Read more >
SLURM Workload Manager - HPC documentation
–mem-per-cpu=<MB>, Memory (RAM) per requested CPU core ; –ntasks-per-node=<num_procs>, Number of (MPI) processes per node. More than one useful only for MPI jobs ......
Read more >
Basic Slurm Commands - High Performance Computing
This line should always be added at the very top of your SBATCH/Slurm script. ... This is because of setting the --jobname parameter...
Read more >
Introducing Slurm - Princeton Research Computing
Slurm scripts are more or less shell scripts with some extra parameters to set the resource requirements: --nodes=1 - specify one node; --ntasks=1...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found