TFX CLI using the TFX Docker container image https://hub.docker.com/r/tensorflow/tfx

System information

• Have I specified the code to reproduce the issue(Yes/No): yes
• Environment in which the code is executed (e.g., Local(Linux/MacOS/Windows), Interactive Notebook, Google Cloud, etc): Cloud Build
• TensorFlow version (you are using): /
• TFX Version: 0.28.0
• Python version: 3

Describe the current behavior The TFX Docker container image (https://hub.docker.com/r/tensorflow/tfx) runs into error when using as part of a CI/CD pipeline (TFX CLI)

Error:

Step #1: Status: Downloaded newer image for tensorflow/tfx:latest
Step #1: docker.io/tensorflow/tfx:latest
Step #1: 2021/03/19 18:50:40 No id provided.
Finished Step #1
ERROR
ERROR: build step 1 "tensorflow/tfx" failed: step exited with non-zero status: 1

Usage:

- name: 'tensorflow/tfx'
    args: ['pipeline', 'create', '--engine', 'kubeflow', '--pipeline_path', 'runner.py', '--endpoint', 'removed']
    dir: 'pipeline'

In my opinion this would be working with the default TFX container image. Can someone confirm or deny? As workaround, I created my own docker image which basically calls the same

FROM ...
ENTRYPOINT ["tfx"]

Describe the expected behavior no error

Standalone code to reproduce the issue see above

Name of your Organization (Optional) /

Other info / logs

Include any logs or source code that would be helpful to diagnose the problem. If including tracebacks, please include the full traceback. Large logs and files should be attached.

[SaschaHeyer]

@jiyongjung0 good point give it a try this week and get back to you

[jiyongjung0]

@SaschaHeyer I have a quick question on this.

Have you tried entrypoint config of cloudbuild.yaml? It seems like we can override the entrypoint and don’t need to have a separate image.