question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Need node affinity setting

See original GitHub issue

When running several workers on different nodes, we need to be able to apply key/value properties on nodes that we can set a workflow’s constraint to. We also need a way to put a constraint on workflows to make sure two or more with constraint value of X don’t execute on same node.

Ex 1. Node 1-4 have much faster CPUs, so we set property on the nodes of SPEED=High. Workflow X that needs to always run only on one of those four nodes should have a node affinity rule placed on it where only a node with property SPEED is set to HIGH.

Ex 2. Workflow A, B, and C have activities that are disk or memory intensive and never should run at the same time on the same node.

If no node is available, the workflow can be configured to sit in queue for next available or to cancel/not run.

Issue Analytics

  • State:open
  • Created a year ago
  • Comments:7 (7 by maintainers)

github_iconTop GitHub Comments

2reactions
sfmskywalkercommented, Oct 14, 2022

@jdevillard gave an awesome demo during yesterday’s community meeting that I think will be able to handle this scenario perfectly. I think we can expect a PR soon 😉

1reaction
johnwccommented, Oct 14, 2022

@sfmskywalker it would also be nice to be able to see in the table in the dashboard, what node a workflow executed/excuting on.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Assign Pods to Nodes using Node Affinity
This page shows how to assign a Kubernetes Pod to a particular node using Node Affinity in a Kubernetes cluster. Before you begin...
Read more >
Kubernetes node affinity: examples & instructions -
Kubernetes node affinity is a feature that enables administrators to match pods according to the labels on nodes. It is similar to nodeSelector ......
Read more >
Node Affinity: Key Concepts, Examples, and Troubleshooting
Node affinity is one of the mechanisms Kubernetes provides to define where Kubernetes should schedule a pod. It lets you define nuanced conditions...
Read more >
Kubernetes node affinity: Placing pods on specific nodes
Absolutely, yes. But to do that we need to give some little input to Kubernetes scheduler. The Kubernetes scheduler can be constrained to...
Read more >
Node Affinity in Kubernetes
Node affinity in Kubernetes refers to the ability to assign a Kubernetes pod to a specific node or group of nodes in a...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found