question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Task Instances stuck in "scheduled" state

See original GitHub issue

Apache Airflow version: 2.0.1

Kubernetes version (if you are using kubernetes) (use kubectl version): v1.17.12

Environment:

  • Cloud provider or hardware configuration: AWS EKS
  • OS (e.g. from /etc/os-release):
  • Kernel (e.g. uname -a):
  • Install tools:
  • Others:

What happened: Several Task Instances get scheduled but never move to queued or running. They then become orphan tasks.

What you expected to happen: Tasks to get scheduled and run 😃

How to reproduce it:

Anything else we need to know: I believe the issue is caused by this limit. If we have more Task Instances than Pool Slots Free then some Task Instances may never show up in this query.

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:8 (7 by maintainers)

github_iconTop GitHub Comments

1reaction
ajboscocommented, Feb 20, 2021

Yep, we’re using the KubernetesExecutor

0reactions
kaxilcommented, Mar 10, 2021

Thanks @jedcunningham – assigned to you

Read more comments on GitHub >

github_iconTop Results From Across the Web

Task stuck in "scheduled" or "queued" state, pool has all slots ...
Tasks in "queued" state say Task is in the 'running' state which is not a valid state for execution. The task must be...
Read more >
Airflow tasks get stuck at “Scheduled” status and never gets ...
Tasks stuck in a “queued” state usually mean one of two things, no queue to execute on or no pool to execute in....
Read more >
Tasks are staying in scheduled forever and not running, and ...
Task instance info for each of the stuck tasks (all of the tasks) lists this as the reason: All dependencies are met but...
Read more >
7 Common Errors to Check When Debugging Airflow DAGs
7 Common Errors to Check When Debugging Airflow DAGs. Tasks not running? DAG stuck? Logs nowhere to be found? We've been there.
Read more >
Why my Airflow tasks got stuck in “no_status” and how I fixed it
One of our Airflow DAGs were not scheduling tasks. ... and running half of the tasks, but the other half got stuck in...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found