question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[sdk] v2 Components not supported by LocalClient

See original GitHub issue

Environment

  • KFP version: N/A
  • KFP SDK version: 1.8.9
  • All dependencies version:
kfp                      1.8.9
kfp-pipeline-spec        0.1.13
kfp-server-api           1.7.1

Steps to reproduce

Running this python script

import kfp
import kfp.v2.dsl as dsl

@dsl.component()
def simple():
    print("allo")

@dsl.pipeline(name="test", description="test")
def pipeline():
    simple()

kfp.run_pipeline_func_locally(pipeline, {})

produce:

ERROR:root:WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/local/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/local/lib/python3.7/site-packages/kfp/v2/components/executor_main.py", line 104, in <module>
    executor_main()
  File "/usr/local/lib/python3.7/site-packages/kfp/v2/components/executor_main.py", line 94, in executor_main
    executor_input = json.loads(args.executor_input)
  File "/usr/local/lib/python3.7/json/__init__.py", line 348, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.7/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.7/json/decoder.py", line 353, in raw_decode
    obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting property name enclosed in double quotes: line 1 column 2 (char 1)

ERROR:root:['docker', 'run', '-v', '/var/folders/99/4l_08z0d4yvfc3ywqvh42pr00000gq/T:/var/folders/99/4l_08z0d4yvfc3ywqvh42pr00000gq/T', 'python:3.7', 'sh', '-c', '\n\nif ! [ -x "$(command -v pip)" ]; then\n    python3 -m ensurepip || python3 -m ensurepip --user || apt-get install python3-pip\nfi\n\nPIP_DISABLE_PIP_VERSION_CHECK=1 python3 -m pip install --quiet     --no-warn-script-location \'kfp==1.8.9\' && "$0" "$@"\n', 'sh', '-ec', 'program_path=$(mktemp -d)\nprintf "%s" "$0" > "$program_path/ephemeral_component.py"\npython3 -m kfp.v2.components.executor_main                         --component_module_path                         "$program_path/ephemeral_component.py"                         "$@"\n', '\nimport kfp\nfrom kfp.v2 import dsl\nfrom kfp.v2.dsl import *\nfrom typing import *\n\ndef simple():\n    print("allo")\n\n', '--executor_input', '{{$}}', '--function_to_execute', 'simple']

Expected result

To have the same result as if simple was a v1 component

import kfp
from kfp.components import create_component_from_func
import kfp.dsl as dsl

@create_component_from_func
def simple():
    print("allo")

@dsl.pipeline(name="test", description="test")
def pipeline():
    simple()

Impacted by this bug? Give it a 👍. We prioritise the issues with the most 👍.

Issue Analytics

  • State:open
  • Created 2 years ago
  • Reactions:3
  • Comments:6 (3 by maintainers)

github_iconTop GitHub Comments

4reactions
lynnmatrixcommented, Dec 31, 2021

@chensun @gpoulin-hopper Actually I have implemented the local client for v2 which is only used internally for now. If needed I will be happy to pull a PR.

1reaction
frederikfabcommented, Jan 25, 2022

@lynnmatrix yes please!

Read more comments on GitHub >

github_iconTop Results From Across the Web

Introducing Kubeflow Pipelines SDK v2
Learn how to build pipeline components using Pipelines SDK v2. ... It is not longer supported to pass constants to artifact inputs.
Read more >
Implementing Local Client Devices with AWS IoT Greengrass
Deploy the client devices components​​ I will add all three of the components to a new or revised deployment and describe the use...
Read more >
APM Local Client - ITOM Practitioner Portal
Launching Diagnostics application from Admin is not supported. Cross launch for System Health, BPM agents, and RUM applications are not ...
Read more >
What are the common error messages to expect in Web ...
After integrating the Agora Web SDK into your web app, you can debug your code using the console ... Agora Web SDK does...
Read more >
Sierra Chart Does not Support External Service API ...
In the case of trading, the only 2 protocols that Sierra Chart will support is FIX ... Reasons Client-Side API Components Are Not...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found