'kedro run' command does not seem to run run.py script
See original GitHub issueDescription
I have specified the tags and nodes that has to be run in run.py when the ‘kedro run’ command is passed. However, the kedro run does not seem to run the run.py. I am not able to find the solution from the Kedro Documentation too.
Context
Due to this bug, I am not able to run the nodes selectively.
my run.py script
`“”“Application entry point.”“”
from pathlib import Path from typing import Iterable, Type, Dict
from kedro.context import KedroContext, load_context, KedroContextError from kedro.runner import AbstractRunner from kedro.pipeline import Pipeline
from part_count_v1.pipeline import create_pipelines
class ProjectContext(KedroContext):
project_name = "Part Count v1"
project_version = "0.15.3"
def _get_pipelines(self) -> Dict[str, Pipeline]:
return create_pipelines()
def main( tags: Iterable[str] = [“not_once”], env: str = None, runner: Type[AbstractRunner] = None, node_names: Iterable[str] = None, from_nodes: Iterable[str] = None, to_nodes: Iterable[str] = None, from_inputs: Iterable[str] = None, ):
project_context = ProjectContext(Path.cwd(), env=env)
print('********* I am inside the runner, the node_names are {}'.format(node_names))
project_context.run(
tags=tags,
runner=runner,
node_names=node_names,
from_nodes=from_nodes,
to_nodes=to_nodes,
from_inputs=from_inputs,
)
if name == “main”: main() `
Expected Result
only run nodes with tags - “not_once”
Actual Result
The nodes without tags and with different tags in the pipeline are run
Your Environment
Include as many relevant details about the environment in which you experienced the bug:
- Kedro version used (
pip show kedro
orkedro -V
): 0.15.3 - Python version used (
python -V
): 3.7.3 - Operating system and version: ubuntu 18.04.03 LTS
Reaching out for assistance
is there any slack channel or support service to assist my team to embark on using Kedro for our production ready products?
Thanks in advance!
Issue Analytics
- State:
- Created 4 years ago
- Comments:8 (4 by maintainers)
Top GitHub Comments
Thanks @DmitriiDeriabinQB .
I intially tried posting these questions in Stackoverflow but I couldnt create a tag ‘kedro’ hence resorted to github. Now there is a kedro tag on stackoverflow and I have posted this question there!
Thank you for your assistance and I hope to see a growing community using kedro:)
@pryanga-wk Pipeline determines the node execution order exclusively based on dataset dependencies (node
inputs
andoutputs
) at the moment. So the only option to dictate that the nodeA
should run before nodeB
is to put a dummy dataset as an output of nodeA
and an input of nodeB
.Also, could I suggest you to post such kind of “how to” questions on Stackoverflow (and tag it with
kedro
)? Since other users may also benefit from the answers and, arguably, SO is more googleable. Thank you.