question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[Feature][API][backend] Query all upstream and downstream dependencies of the task

See original GitHub issue

*For better global communication, please give priority to using English description, thx! *

Please review https://dolphinscheduler.apache.org/en-us/docs/development/issue.html when describe an issue.

Describe the feature In order to view the dependency realations of one task node clearly,It’s necessary to query the upstream and downstream dependencies of this task.

1.According to the process definition id and task name, you can get its direct upstream and downstream dependencies. 2.Only need to get the direct dependencies here, instead of recursively querying all the dependencies. 3.Query the dependencies can support three query types.

  • Upstream dependency
  • Downstream dependency
  • Upstream and downstream dependency.

Design detail

There is process_definiton_json field in the process definition table. The tasks field is a task array that records all tasks. This json needs to be parsed to get the upstream and downstream dependencies of tasks.

image

The json structure of tasks For the json structure of tasks, you can see the picture below. image

Issue Analytics

  • State:open
  • Created 3 years ago
  • Comments:7 (6 by maintainers)

github_iconTop GitHub Comments

1reaction
IamMujuziMosescommented, Nov 26, 2020

Thank you @lgcareer @djkevincr, I am looking forward to working on this and accomplishing with your help

1reaction
lgcareercommented, Nov 26, 2020

@iamMujuziMoses Congratulations to you and welcome you selected this feature,if you have any question,you can feel free to ask and discuss here.

Read more comments on GitHub >

github_iconTop Results From Across the Web

What is Upstream and Downstream in Software Development?
Applying the Dependency Rule, we can safely say that component A is upstream from component B which is upstream from component C (even...
Read more >
[Bug][Sql] Failed to import SQL file of sql ... - GitHub
lgcareer mentioned this issue on Oct 25, 2020. [Feature][API][backend] Query all upstream and downstream dependencies of the task #3797.
Read more >
Dependencies UI: View an entity's upstream and downstream ...
An entity's dependencies page shows the selected entity's upstream and downstream dependencies for apps, services, databases, and hosts.
Read more >
Concepts — Airflow Documentation - Apache Airflow
Though the normal workflow behavior is to trigger tasks when all their directly upstream tasks have succeeded, Airflow allows for more complex dependency...
Read more >
Api - ploomber.DAG
Function to serialize products from PythonCallable tasks. ... Python API: ... Runs the DAG in order so that all upstream dependencies are run...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found