Should the compiler generate Pipeline or PipelineRun
See original GitHub issueThis is a general discussion, not a work item.
Conceptually a Pipeline
is a static specification orchestrating how a set of Task
s should be executed. A PipelineRun
is an instantiation of a pipeline. A pipeline is a re-usable artifact that can be “run” repeatedly, a pipeline-run is one-and-done.
Currently the KFP-Tekton compiler generates a YAML with (multiple) Tasks
(s) and one Pipeline
document. There are however certain features supported by the KFP DSL which are not easily transferred into an equivalent feature in Tekton Pipelines
, but instead require the concept of a PipelineRun
, like mounting PVC volume to a pipeline workspace or setting a timeout at the pipeline level.
Linked issues
Issue Analytics
- State:
- Created 3 years ago
- Comments:21 (18 by maintainers)
Top Results From Across the Web
Tekton Pipelines
A Pipeline requires PipelineResources to provide inputs and store outputs for the Tasks that comprise it. You can declare those in the resources...
Read more >Able to start pipelinerun from pipelinerun spec without ...
The pipelinerun does not create any taskruns/pods . When I do kubectl apply -f to a pipelinerun spec which does not provide volume...
Read more >CI/CD pipelines - GitLab Docs
Pipelines can be manually executed, with predefined or manually-specified variables. You might do this if the results of a pipeline (for example, a...
Read more >Build a pipeline | Vertex AI | Google Cloud
Compiler . You create a pipeline run on Vertex AI Pipelines using the Vertex AI Python client. When you run a pipeline, you...
Read more >Build a Pipeline | Kubeflow
A tutorial on building pipelines to orchestrate your ML workflow. ... Not having this artifact available could make it harder to debug this ......
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
I think @Tomcli 's approach (PR #62) with generating an optional
PipelineRun
in addition to the existingPipeline
withTasks
will be the best compromise and allows to keep existing code intact. At least for the time being.@Tomcli: Closing this issue.
In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.