question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Pipeline migration produces invalid container image reference in pipeline file

See original GitHub issue

Describe the issue

Currently we have two hooks touching the same value (runtime image) which are expected to occur sequentially, but are actually triggered separately by changes to the jupyterlab widget content and the canvas content respectively. In theory this should be the same, but is causing this race condition when only the widget detects changes but the canvas does not.

To Reproduce Steps to reproduce the behavior:

  1. Clone https://github.com/elyra-ai/examples

  2. Open examples/pipelines/dax_noaa_weather_data/analyze_NOAA_weather_data.pipeline in a text editor and review all runtime_image property values:

    "runtime_image": "docker.io/amancevice/pandas:1.1.1"
    
  3. Open examples/pipelines/dax_noaa_weather_data/analyze_NOAA_weather_data.pipeline in the VPE

  4. The migration wizard opens. Migrate the pipeline.

  5. Save the pipeline and close the pipeline editor.

  6. Open the pipeline file again in a text editor and review the runtime_image property values:

    "runtime_image": "Pandas 1.1.1"
    

    Note that the updated values are not valid container image names.

  7. Try to run the pipeline. It fails because there is no image with such a name.

Expected behavior

The two hooks content should either not be dependent on each other or we should make sure one hook triggers the next if that behavior is expected.

Deployment information Describe what you’ve deployed and how:

  • Elyra version: 3.2/rc0

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:9 (9 by maintainers)

github_iconTop GitHub Comments

1reaction
ptitzlercommented, Oct 7, 2021

IIUC this will still work if using only the VPE since it converts it to the correct format at submission.

It doesn’t seem to run from the VPE either when you run the pipeline after the migration without doing anything else.

0reactions
ajbozarthcommented, Oct 14, 2021

I tracked down the issue and opened #2231 with a fix. The actual bug is described in detail there

Read more comments on GitHub >

github_iconTop Results From Across the Web

Troubleshooting CI/CD - GitLab Docs
The pipeline shows a yaml invalid badge and does not start running if any syntax or formatting problems are found. Edit .gitlab-ci.yml with...
Read more >
Build and push a docker image with build arguments from ...
I'm building a docker image in an Azure DevOps pipeline, then I want to push it to the Azure Container registry.
Read more >
Use custom containers in Dataflow | Google Cloud
This page describes how to customize the runtime environment of user code in Dataflow pipelines by supplying a custom container image. Custom containers...
Read more >
Troubleshoot pipeline runs - Azure DevOps - Microsoft Learn
Learn how to troubleshoot pipeline runs in Azure Pipelines and Team Foundation Server.
Read more >
Known Issues - Setting up the Registry | Configuring Clusters
These errors are returned by an internal registry service when Docker attempts to push the image. Its cause originates in the synchronization of...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found