Lightrun
question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Airflow Tree View for larger dags

See original GitHub issue

Hi, Airflow Web UI shows nothing on tree view for larger dags (more than 100 tasks), although it’s working fine for smaller dags. Anything that is needed to be configured in airflow.cfg to support larger dags in the UI?

alt larger

Smaller Dag:

alt smaller

Apache Airflow version: 2.1.0 (Celery)

Environment:

  • Cloud provider or hardware configuration: AWS EC2
  • OS (e.g. from /etc/os-release): Ubuntu 18.04
  • Kernel (e.g. uname -a): 5.4.0-1045-aws
  • Install tools: pip

What you expected to happen: It is rendering correctly on Airflow 1.10.13 (Sequential)

image

How to reproduce it: Create a sample dag with >= 100 tasks

Anything else we need to know: The cli command for viewing dag tree is working correctly airflow tasks list services_data_sync --tree

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Reactions:2
  • Comments:16 (8 by maintainers)

github_iconTop GitHub Comments

1reaction
syedshameersarwarcommented, Jun 14, 2021

@fjmacagno @syedshameersarwar Does this happen when the auto-refresh is on, or whenever?

Yeah, it’s always the same for me, auto-refresh on or off

1reaction
fjmacagnocommented, Jun 14, 2021

@fjmacagno @syedshameersarwar Does this happen when the auto-refresh is on, or whenever?

Whenever

Read more comments on GitHub >

github_iconTop Results From Across the Web

UI / Screenshots - Apache Airflow
Tree View ¶. A tree representation of the DAG that spans across time. If a pipeline is late, you can quickly see where...
Read more >
Airflow 2.3 — New Grid View
The new grid view is the starting point for an immersive experience in which — by clicking on individual tasks (i.e., grid squares)...
Read more >
Clean tree view in Airflow interface - python
Also, in the Airflow web app, you can adjust the number of runs dropdown in the DAG Tree View to show a bigger/smaller...
Read more >
Airflow UI Walkthrough
The tree view also represents the DAG. If you think your pipeline took a longer time to execute than expected then you can...
Read more >
A Deep Dive into the Airflow UI - YouTube
... DAGs and DAG runs through the graph view and the (now replaced) tree view, but the UI has many other powerful views,...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found
Previous page

When triggering a job via airfow UI, job fails abruptly with Negsignal.SIGSEGV

Next page

LocalTaskJob heartbeat race condition with finishing task causing SIGTERM