question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Kubeflow Visualizations Have all Become Broken as of 0.29

See original GitHub issue

With recent release of TFX, artifacts paths have been changing and no longer work in Kubeflow. Shouldn’t the changes be communicated with the Kubeflow maintainers? They are still hard-coded to the old paths:

https://github.com/kubeflow/pipelines/blob/master/frontend/src/lib/OutputArtifactLoader.ts#L273-L274

Ideally both old and new paths should be supported.

I’m currently on Kubeflow 1.4.0 with TFX 0.30.0 and all visualizations (including evaluator given there is a baseline (though patched in master)) are broken.

As I upgraded from 0.27, and the tensorboard visualization doesn’t seem to work either as it seems to not be included in the ml-pipeline-ui-metadata.tgz anymore for some reason.

https://github.com/tensorflow/tfx/blob/e43ee84f973ec63c8af5ee18a8508b1d5adb7abf/tfx/orchestration/kubeflow/container_entrypoint.py#L354

As I just mentioned ml-pipeline-ui-metadata: Can you also please consider moving /ml-pipeline-ui-metadata.json out of the root folder to say /output/ml-pieline-ui-metadata.json?

Writing to /ml-pipeline-ui-metadata.jsonmakes it impossible to use non docker (which as you all know is deprecated now) kubeflow deployments:

https://github.com/kubeflow/pipelines/issues/1654

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Reactions:4
  • Comments:5 (1 by maintainers)

github_iconTop GitHub Comments

2reactions
zijianjoycommented, Jul 13, 2021

https://github.com/kubeflow/pipelines/pull/5999 has merged to fix this issue, expect to be included in the next KFP release. After upgrade, KFP requires users to upgrade TFX to be >0.30.0 for adopting this change.

1reaction
axeltidemanncommented, Jun 21, 2021

It would be awesome to get this fixed. On another thread, it was reported that Kubeflow Pipelines 1.6.0 will fix the missing visualisations.

Read more comments on GitHub >

github_iconTop Results From Across the Web

[release] 1.7.0 tracker · Issue #5779 · kubeflow/pipelines
Kubeflow Visualizations Have all Become Broken as of 0.29 tensorflow/tfx#3933. After release: manual verification of fix [bug] GCP marketplace default ...
Read more >
Visualize Results in the Pipelines UI - Kubeflow
This page shows you how to use the Kubeflow Pipelines UI to visualize output from a Kubeflow Pipelines component. For details about how...
Read more >
Python Based Visualizations (Deprecated) - Kubeflow
This page describes Python based visualizations, how to create them, and how to use them to visualize results within the Kubeflow Pipelines ...
Read more >
Troubleshooting | Kubeflow
This page presents some hints for troubleshooting specific problems that you may encounter. Diagnosing problems in your Kubeflow Pipelines ...
Read more >
Pipeline Metrics - Kubeflow
Pipeline Metrics. Export and visualize pipeline metrics. This page shows you how to export metrics from a Kubeflow Pipelines component. For ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found