question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

'kedro run' command does not seem to run run.py script

See original GitHub issue

Description

I have specified the tags and nodes that has to be run in run.py when the ‘kedro run’ command is passed. However, the kedro run does not seem to run the run.py. I am not able to find the solution from the Kedro Documentation too.

Context

Due to this bug, I am not able to run the nodes selectively.

my run.py script

`“”“Application entry point.”“”

from pathlib import Path from typing import Iterable, Type, Dict

from kedro.context import KedroContext, load_context, KedroContextError from kedro.runner import AbstractRunner from kedro.pipeline import Pipeline

from part_count_v1.pipeline import create_pipelines

class ProjectContext(KedroContext):

project_name = "Part Count v1"
project_version = "0.15.3"

def _get_pipelines(self) -> Dict[str, Pipeline]:
    return create_pipelines()

def main( tags: Iterable[str] = [“not_once”], env: str = None, runner: Type[AbstractRunner] = None, node_names: Iterable[str] = None, from_nodes: Iterable[str] = None, to_nodes: Iterable[str] = None, from_inputs: Iterable[str] = None, ):

project_context = ProjectContext(Path.cwd(), env=env)
print('********* I am inside the runner, the node_names are {}'.format(node_names))
project_context.run(
    tags=tags,
    runner=runner,
    node_names=node_names,
    from_nodes=from_nodes,
    to_nodes=to_nodes,
    from_inputs=from_inputs,
)

if name == “main”: main() `

Expected Result

only run nodes with tags - “not_once”

Actual Result

The nodes without tags and with different tags in the pipeline are run

Your Environment

Include as many relevant details about the environment in which you experienced the bug:

  • Kedro version used (pip show kedro or kedro -V): 0.15.3
  • Python version used (python -V): 3.7.3
  • Operating system and version: ubuntu 18.04.03 LTS

Reaching out for assistance

is there any slack channel or support service to assist my team to embark on using Kedro for our production ready products?

Thanks in advance!

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:8 (4 by maintainers)

github_iconTop GitHub Comments

2reactions
pryanga-wkcommented, Nov 4, 2019

Thanks @DmitriiDeriabinQB .

I intially tried posting these questions in Stackoverflow but I couldnt create a tag ‘kedro’ hence resorted to github. Now there is a kedro tag on stackoverflow and I have posted this question there!

Thank you for your assistance and I hope to see a growing community using kedro:)

2reactions
DmitriiDeriabinQBcommented, Nov 1, 2019

@pryanga-wk Pipeline determines the node execution order exclusively based on dataset dependencies (node inputs and outputs) at the moment. So the only option to dictate that the node A should run before node B is to put a dummy dataset as an output of node A and an input of node B.

Also, could I suggest you to post such kind of “how to” questions on Stackoverflow (and tag it with kedro)? Since other users may also benefit from the answers and, arguably, SO is more googleable. Thank you.

Read more comments on GitHub >

github_iconTop Results From Across the Web

'kedro run' command does not seem to run run.py script #132
I have specified the tags and nodes that has to be run in run.py when the 'kedro run' command is passed. However, the...
Read more >
kedro run as a python command instead of command line
My question now is how do I run it as a python command? From the documentation I read that the command kedro run...
Read more >
Frequently asked questions — Kedro 0.18.4 documentation
If you want to try out the latest, most novel functionality of Kedro which has not been released yet, you can run the...
Read more >
Set up PyCharm — Kedro 0.18.4 documentation
Click Finish. Go to Run / Debug Configurations to add a Remote Run. Select the remote interpreter that you have just created. For...
Read more >
Configuration — Kedro 0.18.4 documentation - Read the Docs
To use additional configuration environments, run the following command: kedro run --env=test. Copy to clipboard. If no env option is specified, this will...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found