[Installation]: 8080 failed - port is already allocated

Installation check

• I have read the installation guide.

Installation OS

Windows

Installation Method

Docker

Kubernetes Cluster Type

N/A - Docker

MLRun Kit Helm Chart Version

0.3.3

Issue Description

From time to time, it is not possible to connect to MLRun (it generate timeout also in simple command ‘import mlrun’ see attached jupyter notebook). issue in jupyter notebook - see timeout during import.ipynb.txt

I checked current state of docker compose and I saw: Error invoking remote method 'docker-start-container': Error: (HTTP code 500) server error - driver failed programming external connectivity on endpoint desktopdockertools-mlrun-api-1 (a5a67db8a74bf4981d44477ffb77dccb25d2401d8fdd95c64262de30ed6d1a56): Bind for 0.0.0.0:8080 failed: port is already allocated Addition details, see attachments: docker - 8080 failed port is already allocated .txt

Installation Logs

Microsoft Windows [Version 10.0.19044.2006] © Microsoft Corporation. All rights reserved.

C:\Users\jiri.steuer>mlrun-local2

C:\Users\jiri.steuer>set HOST_IP=127.0.0.1

C:\Users\jiri.steuer>set SHARED_DIR=c:\apps\mlrun-data

C:\Users\jiri.steuer>mkdir c:\apps\mlrun-data A subdirectory or file c:\apps\mlrun-data already exists.

C:\Users\jiri.steuer>docker-compose -f “c:\Apps\Desktop Docker Tools\compose.with-jupyter.yaml” up time=“2022-09-24T10:29:48+02:00” level=warning msg=“Found orphan containers ([desktopdockertools-mlrun-api-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up.” [+] Running 3/0

• Container desktopdockertools-mlrun-ui-1 Created 0.0s
• Container desktopdockertools-nuclio-1 Created 0.0s
• Container desktopdockertools-jupyter-1 Created 0.0s Attaching to desktopdockertools-jupyter-1, desktopdockertools-mlrun-ui-1, desktopdockertools-nuclio-1 desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: using the “epoll” event method desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: nginx/1.21.6 desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: built by gcc 10.3.1 20211027 (Alpine 10.3.1_git20211027) desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: OS: Linux 5.10.102.1-microsoft-standard-WSL2 desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: getrlimit(RLIMIT_NOFILE): 1048576:1048576 desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: start worker processes desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: start worker process 11 desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: start worker process 12 desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: start worker process 13 desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: start worker process 14 desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: start worker process 15 desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: start worker process 16 desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: start worker process 17 desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: start worker process 18 desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: start worker process 19 desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: start worker process 20 desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: start worker process 21 desktopdockertools-mlrun-ui-1 | 2022/09/24 08:29:50 [notice] 10#10: start worker process 22 desktopdockertools-nuclio-1 | Running in parallel desktopdockertools-jupyter-1 | Executing the command: jupyter lab --ip=0.0.0.0 --port=8888 --NotebookApp.token= --NotebookApp.password= --NotebookApp.default_url=/lab desktopdockertools-nuclio-1 | Starting dashboard desktopdockertools-nuclio-1 | Starting nginx desktopdockertools-nuclio-1 | 22.09.24 08:29:50.904 hboard.healthcheck.server (I) Listening {“listenAddress”: “:8082”} desktopdockertools-nuclio-1 | 22.09.24 08:29:50.906 rd.platform.docker.runner (D) Executing {“command”: “docker version --format "{{json .}}"”} desktopdockertools-nuclio-1 | 22.09.24 08:29:51.321 rd.platform.docker.runner (D) Command executed successfully {“output”: “{"Client":{"Platform":{"Name":"Docker Engine - Community"},"Version":"19.03.14","ApiVersion":"1.40","DefaultAPIVersion":"1.40","GitCommit":"5eb3275","GoVersion":"go1.13.15","Os":"linux","Arch":"amd64","BuildTime":"Tue Dec 1 19:14:24 2020","Experimental":false},"Server":{"Platform":{"Name":"Docker Desktop 4.12.0 (85629)"},"Components":[{"Name":"Engine","Version":"20.10.17","Details":{"ApiVersion":"1.41","Arch":"amd64","BuildTime":"Mon Jun 6 23:01:23 2022","Experimental":"false","GitCommit":"a89b842","GoVersion":"go1.17.11","KernelVersion":"5.10.102.1-microsoft-standard-WSL2","MinAPIVersion":"1.12","Os":"linux"}},{"Name":"containerd","Version":"1.6.8","Details":{"GitCommit":"9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6"}},{"Name":"runc","Version":"1.1.4","Details":{"GitCommit":"v1.1.4-0-g5fd4c4d"}},{"Name":"docker-init","Version":"0.19.0","Details":{"GitCommit":"de40ad0"}}],"Version":"20.10.17","ApiVersion":"1.41","MinAPIVersion":"1.12","GitCommit":"a89b842","GoVersion":"go1.17.11","Os":"linux","Arch":"amd64","KernelVersion":"5.10.102.1-microsoft-standard-WSL2","BuildTime":"2022-06-06T23:01:23.000000000+00:00"}}\n”, “stderr”: “”, “exitCode”: 0} desktopdockertools-nuclio-1 | 22.09.24 08:29:51.321 rd.platform.docker.runner (D) Executing {“command”: “docker version --format "{{json .}}"”} desktopdockertools-nuclio-1 | 22.09.24 08:29:51.389 rd.platform.docker.runner (D) Command executed successfully {“output”: “{"Client":{"Platform":{"Name":"Docker Engine - Community"},"Version":"19.03.14","ApiVersion":"1.40","DefaultAPIVersion":"1.40","GitCommit":"5eb3275","GoVersion":"go1.13.15","Os":"linux","Arch":"amd64","BuildTime":"Tue Dec 1 19:14:24 2020","Experimental":false},"Server":{"Platform":{"Name":"Docker Desktop 4.12.0 (85629)"},"Components":[{"Name":"Engine","Version":"20.10.17","Details":{"ApiVersion":"1.41","Arch":"amd64","BuildTime":"Mon Jun 6 23:01:23 2022","Experimental":"false","GitCommit":"a89b842","GoVersion":"go1.17.11","KernelVersion":"5.10.102.1-microsoft-standard-WSL2","MinAPIVersion":"1.12","Os":"linux"}},{"Name":"containerd","Version":"1.6.8","Details":{"GitCommit":"9cd3357b7fd7218e4aec3eae239db1f68a5a6ec6"}},{"Name":"runc","Version":"1.1.4","Details":{"GitCommit":"v1.1.4-0-g5fd4c4d"}},{"Name":"docker-init","Version":"0.19.0","Details":{"GitCommit":"de40ad0"}}],"Version":"20.10.17","ApiVersion":"1.41","MinAPIVersion":"1.12","GitCommit":"a89b842","GoVersion":"go1.17.11","Os":"linux","Arch":"amd64","KernelVersion":"5.10.102.1-microsoft-standard-WSL2","BuildTime":"2022-06-06T23:01:23.000000000+00:00"}}\n”, “stderr”: “”, “exitCode”: 0} desktopdockertools-nuclio-1 | 22.09.24 08:29:51.389 dashboard (D) Initializing platform {“platformType”: “local”} desktopdockertools-nuclio-1 | 22.09.24 08:29:51.389 dashboard.platform.docker (D) Executing in container {“containerID”: “nuclio-local-storage-reader”, “execOptions”: {“Command”:“/bin/sh -c "/bin/cat /etc/nuclio/store/projects/nuclio/default.json"”,“Stdout”:“”,“Stderr”:“”,“Env”:null}} desktopdockertools-nuclio-1 | 22.09.24 08:29:51.389 rd.platform.docker.runner (D) Executing {“command”: “docker exec nuclio-local-storage-reader /bin/sh -c "/bin/cat /etc/nuclio/store/projects/nuclio/default.json"”} desktopdockertools-nuclio-1 | 22.09.24 08:29:51.487 rd.platform.docker.runner (D) Failed to execute command {“output”: “Error: No such container: nuclio-local-storage-reader\n”, “stderr”: “”, “exitCode”: 1, “err”: “exit status 1”} desktopdockertools-nuclio-1 | 22.09.24 08:29:51.487 dashboard.platform.docker (D) Failed to execute command in container {“err”: “stdout:\nError: No such container: nuclio-local-storage-reader\n\nstderr:\n”, “errVerbose”: “\nError - exit status 1\n /nuclio/pkg/cmdrunner/shellrunner.go:96\n\nCall stack:\nstdout:\nError: No such container: nuclio-local-storage-reader\n\nstderr:\n\n /nuclio/pkg/cmdrunner/shellrunner.go:96\nstdout:\nError: No such container: nuclio-local-storage-reader\n\nstderr:\n”, “stdout”: “Error: No such container: nuclio-local-storage-reader\n”, “stderr”: “”} desktopdockertools-nuclio-1 | 22.09.24 08:29:51.488 dashboard.platform.docker (D) Running container {“imageName”: “gcr.io/iguazio/alpine:3.15”, “runOptions”: {“Ports”:null,“ContainerName”:“nuclio-local-storage-reader”,“Env”:null,“Labels”:null,“Volumes”:{“nuclio-local-storage”:“/etc/nuclio/store”},“Remove”:true,“Command”:“/bin/sh -c "/bin/sleep 6h"”,“Stdout”:“”,“Stderr”:null,“Attach”:false,“ImageMayNotExist”:true,“Network”:“”,“RestartPolicy”:null,“GPUs”:“”,“MountPoints”:null,“RunAsUser”:null,“RunAsGroup”:null,“FSGroup”:null}} desktopdockertools-nuclio-1 | 22.09.24 08:29:51.488 rd.platform.docker.runner (D) Executing {“command”: “docker run -d --rm --name nuclio-local-storage-reader --volume nuclio-local-storage:/etc/nuclio/store gcr.io/iguazio/alpine:3.15 /bin/sh -c "/bin/sleep 6h"”} desktopdockertools-nuclio-1 | 22.09.24 08:29:52.287 rd.platform.docker.runner (D) Command executed successfully {“output”: “e221568e9308587feba7163af2626d3e2b12485cce5fce3b0b4ba36f157a6349\n”, “stderr”: “”, “exitCode”: 0} desktopdockertools-nuclio-1 | 22.09.24 08:29:52.287 dashboard.platform.docker (D) Executing in container {“containerID”: “nuclio-local-storage-reader”, “execOptions”: {“Command”:“/bin/sh -c "/bin/cat /etc/nuclio/store/projects/nuclio/default.json"”,“Stdout”:“”,“Stderr”:“”,“Env”:null}} desktopdockertools-nuclio-1 | 22.09.24 08:29:52.287 rd.platform.docker.runner (D) Executing {“command”: “docker exec nuclio-local-storage-reader /bin/sh -c "/bin/cat /etc/nuclio/store/projects/nuclio/default.json"”} desktopdockertools-nuclio-1 | parallel: This job failed: desktopdockertools-nuclio-1 | /runners/dashboard.sh desktopdockertools-nuclio-1 | 22.09.24 08:29:53.163 rd.platform.docker.runner (D) Command executed successfully {“output”: “eyJtZXRhIjp7Im5hbWUiOiJkZWZhdWx0IiwibmFtZXNwYWNlIjoibnVjbGlvIn0sInNwZWMiOnt9LCJzdGF0dXMiOnsidXBkYXRlZEF0IjoiMjAyMi0wNi0xNlQxNTo1NzowNS44NTM0OTYzMzhaIn19\n”, “stderr”: “”, “exitCode”: 0} desktopdockertools-nuclio-1 | 22.09.24 08:29:53.168 dashboard (D) Fetching function templates from git repository {“templatesGitRepository”: “https://github.com/nuclio/nuclio-templates.git”, “templatesGitRef”: “refs/heads/master”} desktopdockertools-nuclio-1 | 22.09.24 08:29:53.184 itFunctionTemplateFetcher (D) Fetching templates from git {“ref”: “refs/heads/master”} desktopdockertools-nuclio-1 | desktopdockertools-nuclio-1 | Error - Get “https://github.com/nuclio/nuclio-templates.git/info/refs?service=git-upload-pack”: dial tcp: lookup github.com on 127.0.0.11:53: no such host desktopdockertools-nuclio-1 | …/gitfunctiontemplatefetcher.go:109 desktopdockertools-nuclio-1 | desktopdockertools-nuclio-1 | Call stack: desktopdockertools-nuclio-1 | Failed to initialize git repository desktopdockertools-nuclio-1 | …/gitfunctiontemplatefetcher.go:109 desktopdockertools-nuclio-1 | Failed to clone repository desktopdockertools-nuclio-1 | …/gitfunctiontemplatefetcher.go:67 desktopdockertools-nuclio-1 | Failed to fetch one of given templateFetchers desktopdockertools-nuclio-1 | …/dashboard/functiontemplates/repository.go:35 desktopdockertools-nuclio-1 | Failed to create repository out of given fetchers desktopdockertools-nuclio-1 | /nuclio/cmd/dashboard/app/run.go:286 desktopdockertools-nuclio-1 | Failed to create new dashboard desktopdockertools-nuclio-1 | /nuclio/cmd/dashboard/app/run.go:137 desktopdockertools-jupyter-1 | [W 2022-09-24 08:29:53.291 LabApp] ‘token’ has moved from NotebookApp to ServerApp. This config will be passed to ServerApp. Be sure to update your config before our next release. desktopdockertools-jupyter-1 | [W 2022-09-24 08:29:53.291 LabApp] ‘password’ has moved from NotebookApp to ServerApp. This config will be passed to ServerApp. Be sure to update your config before our next release. desktopdockertools-jupyter-1 | [W 2022-09-24 08:29:53.291 LabApp] ‘password’ has moved from NotebookApp to ServerApp. This config will be passed to ServerApp. Be sure to update your config before our next release. desktopdockertools-jupyter-1 | [I 2022-09-24 08:29:53.304 ServerApp] jupyterlab | extension was successfully linked. desktopdockertools-jupyter-1 | [I 2022-09-24 08:29:53.322 ServerApp] nbclassic | extension was successfully linked. desktopdockertools-nuclio-1 | Exiting desktopdockertools-jupyter-1 | [I 2022-09-24 08:29:53.603 ServerApp] notebook_shim | extension was successfully linked. desktopdockertools-jupyter-1 | [W 2022-09-24 08:29:53.730 ServerApp] All authentication is disabled. Anyone who can connect to this server will be able to run code. desktopdockertools-jupyter-1 | [I 2022-09-24 08:29:53.735 ServerApp] notebook_shim | extension was successfully loaded. desktopdockertools-jupyter-1 | [I 2022-09-24 08:29:53.737 LabApp] JupyterLab extension loaded from /opt/conda/lib/python3.8/site-packages/jupyterlab desktopdockertools-jupyter-1 | [I 2022-09-24 08:29:53.738 LabApp] JupyterLab application directory is /opt/conda/share/jupyter/lab desktopdockertools-jupyter-1 | [I 2022-09-24 08:29:53.744 ServerApp] jupyterlab | extension was successfully loaded. desktopdockertools-jupyter-1 | [I 2022-09-24 08:29:53.761 ServerApp] nbclassic | extension was successfully loaded. desktopdockertools-jupyter-1 | [I 2022-09-24 08:29:53.761 ServerApp] Serving notebooks from local directory: /home/jovyan desktopdockertools-jupyter-1 | [I 2022-09-24 08:29:53.762 ServerApp] Jupyter Server 1.18.1 is running at: desktopdockertools-jupyter-1 | [I 2022-09-24 08:29:53.762 ServerApp] http://666a523b5037:8888/lab desktopdockertools-jupyter-1 | [I 2022-09-24 08:29:53.762 ServerApp] or http://127.0.0.1:8888/lab desktopdockertools-jupyter-1 | [I 2022-09-24 08:29:53.762 ServerApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation). desktopdockertools-nuclio-1 exited with code 0 desktopdockertools-jupyter-1 | > 2022-09-24 08:30:02,890 [info] Initializing DB data desktopdockertools-jupyter-1 | > 2022-09-24 08:30:02,891 [debug] Waiting for database liveness desktopdockertools-jupyter-1 | > 2022-09-24 08:30:02,891 [debug] SQLite DB is used, liveness check not needed desktopdockertools-jupyter-1 | INFO [alembic.runtime.migration] Context impl SQLiteImpl. desktopdockertools-jupyter-1 | INFO [alembic.runtime.migration] Will assume non-transactional DDL. desktopdockertools-jupyter-1 | INFO [alembic.runtime.migration] Context impl SQLiteImpl. desktopdockertools-jupyter-1 | INFO [alembic.runtime.migration] Will assume non-transactional DDL. desktopdockertools-jupyter-1 | > 2022-09-24 08:30:03,001 [info] Checking if migration is needed: {‘is_migration_from_scratch’: False, ‘is_schema_migration_needed’: False, ‘is_data_migration_needed’: False, ‘is_database_migration_needed’: False, ‘is_backup_needed’: False, ‘is_migration_needed’: False} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:03,002 [info] Creating initial data desktopdockertools-jupyter-1 | > 2022-09-24 08:30:03,002 [info] Initial data created desktopdockertools-jupyter-1 | > 2022-09-24 08:30:03,002 [info] Starting API server: {‘port’: 8080, ‘debug’: False} desktopdockertools-jupyter-1 | INFO: Started server process [51] desktopdockertools-jupyter-1 | INFO [uvicorn.error] Started server process [51] desktopdockertools-jupyter-1 | INFO: Waiting for application startup. desktopdockertools-jupyter-1 | INFO [uvicorn.error] Waiting for application startup. desktopdockertools-jupyter-1 | > 2022-09-24 08:30:03,537 [info] configuration dump: {‘dumped_config’: ‘dask_kfp_image: ''\n_dbpath: ''\n_iguazio_api_url: ''\n_kfp_image: ''\napi_base_version: v1\nartifact_path: /home/jovyan/data\nbackground_color: '#4EC64B'\nbackground_tasks:\n default_timeouts:\n operations:\n migrations: '3600'\n runtimes:\n dask: '600'\n timeout_mode: enabled\nbuilder_alpine_image: alpine:3.13.1\ndatastore:\n async_source_mode: disabled\ndbpath: ''\ndefault_archive: ''\ndefault_base_image: mlrun/mlrun\ndefault_function_node_selector: e30=\ndefault_function_pod_resources:\n limits:\n cpu: null\n gpu: null\n memory: null\n requests:\n cpu: null\n gpu: null\n memory: null\ndefault_function_priority_class_name: ''\ndefault_nuclio_runtime: python:3.7\ndefault_project: default\ndefault_samples_path: https://s3.wasabisys.com/iguazio/\ndefault_tensorboard_logs_path: /User/.tensorboard/{{project}}\nenrich_artifact_path_with_workflow_id: true\nfeature_store:\n data_prefixes:\n default: v3io:///projects/{project}/FeatureStore/{name}/{kind}\n nosql: v3io:///projects/{project}/FeatureStore/{name}/{kind}\n redisnosql: redis:///projects/{project}/FeatureStore/{name}/{kind}\n default_job_image: mlrun/mlrun\n default_targets: parquet,nosql\n flush_interval: 300\nforce_run_local: auto\nfunction:\n spec:\n image_pull_secret:\n default: null\n security_context:\n default: e30=\n enrichment_group_id: 65534\n enrichment_mode: disabled\n pipelines:\n kfp_pod_user_unix_id: 5\n service_account:\n default: null\nfunction_defaults:\n image_by_kind:\n dask: mlrun/ml-base\n job: mlrun/mlrun\n mpijob: mlrun/ml-models\n nuclio: mlrun/mlrun\n remote: mlrun/mlrun\n serving: mlrun/mlrun\n preemption_mode: prevent\nhttp_retry_defaults:\n backoff_factor: 1\n max_retries: 3\n status_codes:\n - 500\n - 502\n - 503\n - 504\nhttpdb:\n allowed_file_paths: ''\n api_url: ''\n authentication:\n basic:\n password: ''\n username: ''\n bearer:\n token: ''\n iguazio:\n session_verification_endpoint: data_sessions/verifications/app_service\n mode: none\n authorization:\n mode: none\n opa:\n address: ''\n log_level: 0\n permission_filter_path: ''\n permission_query_path: ''\n request_timeout: 10\n builder:\n build_args: ''\n docker_registry: ''\n docker_registry_secret: ''\n function_target_image_name_prefix_template: func-{project}-{name}\n insecure_pull_registry_mode: auto\n insecure_push_registry_mode: auto\n kaniko_aws_cli_image: amazon/aws-cli:2.7.10\n kaniko_image: gcr.io/kaniko-project/executor:v1.8.0\n kaniko_init_container_image: alpine:3.13.1\n mlrun_version_specifier: ''\n pip_ca_path: /etc/ssl/certs/mlrun/pip-ca-certificates.crt\n pip_ca_secret_key: ''\n pip_ca_secret_name: ''\n clusterization:\n chief:\n port: 8080\n service: mlrun-api-chief\n url: ''\n ensure_function_running_on_chief_mode: enabled\n role: chief\n worker:\n sync_with_chief:\n interval: 15\n mode: enabled\n data_volume: /home/jovyan/data\n db:\n backup:\n file_format: db_backup%Y%m%d%H%M.db\n mode: enabled\n rotation_limit: 3\n use_rotation: true\n commit_retry_interval: 3\n commit_retry_timeout: 30\n conflict_retry_interval: null\n conflict_retry_timeout: 15\n connections_pool_max_overflow: null\n connections_pool_size: null\n data_migrations_mode: enabled\n database_migration_mode: enabled\n db_type: sqldb\n debug: false\n dirpath: /home/jovyan/.mlrun/db\n dsn: sqlite:////home/jovyan/data/mlrun.db?check_same_thread=false\n jobs:\n allow_local_run: false\n logs_path: /home/jovyan/data/logs\n max_workers: 64\n nuclio:\n add_templated_ingress_host_mode: never\n default_service_type: NodePort\n old_dsn: ''\n password: ''\n port: 8080\n projects:\n counters_cache_ttl: 2 minutes\n followers: ''\n iguazio_access_key: ''\n iguazio_list_projects_default_page_size: 200\n leader: mlrun\n periodic_sync_interval: 1 minute\n project_owners_cache_ttl: 30 seconds\n retry_leader_request_on_exception: enabled\n real_path: /home/jovyan/data\n retry_api_call_on_exception: enabled\n scheduling:\n default_concurrency_limit: 1\n min_allowed_interval: 10 minutes\n scheduler_config: '{“job_defaults”: {“misfire_grace_time”: null, “coalesce”: true}}'\n state: online\n token: ''\n user: ''\n v3io_api: ''\n v3io_framesd: ''\nhub_url: https://raw.githubusercontent.com/mlrun/functions/{tag}/{name}/function.yaml\nignored_notebook_tags: ''\nigz_version: ''\nimages_registry: ''\nimages_tag: ''\nimages_to_enrich_registry: ^mlrun/\nipython_widget: true\nkfp_ttl: '14400'\nkfp_url: ''\nlog_formatter: human\nlog_level: DEBUG\nmarketplace:\n catalog_filename: catalog.json\n default_source:\n channel: master\n create: true\n description: MLRun global function hub\n name: mlrun_global_hub\n url: https://raw.githubusercontent.com/mlrun/marketplace\n k8s_secrets_project_name: -marketplace-secrets\nmodel_endpoint_monitoring:\n batch_processing_function_branch: master\n drift_thresholds:\n default:\n drift_detected: 0.7\n possible_drift: 0.5\n parquet_batching_max_events: 10000\n serving_stream_args:\n retention_period_hours: 24\n shard_count: 1\n store_prefixes:\n default: v3io:///users/pipelines/{project}/model-endpoints/{kind}\n user_space: v3io:///projects/{project}/model-endpoints/{kind}\nmpijob_crd_version: ''\nnamespace: ''\nnest_asyncio_enabled: ''\nnuclio_dashboard_url: http://nuclio:8070\nnuclio_version: ''\npackage_path: mlrun\npreemptible_nodes:\n node_selector: e30=\n tolerations: W10=\nredis_url: redis://localhost:6379\nremote_host: ''\nruns_monitoring_interval: '30'\nruns_monitoring_missing_runtime_resources_debouncing_interval: null\nruntime_resources_deletion_grace_period: '14400'\nruntimes_cleanup_interval: '300'\nscrape_metrics: true\nsecret_stores:\n azure_vault:\n default_secret_name: null\n secret_path: ~/.mlrun/azure_vault\n url: https://{name}.vault.azure.net\n kubernetes:\n auth_secret_name: mlrun-auth-secrets.{hashed_access_key}\n auto_add_project_secrets: false\n env_variable_prefix: MLRUN_K8S_SECRET__\n project_secret_name: mlrun-project-secrets-{project}\n vault:\n project_service_account_name: mlrun-vault-{project}\n remote_url: ''\n role: ''\n token_path: ~/.mlrun/vault\n token_ttl: 180000\n url: ''\n user_token: ''\nspark_app_image: ''\nspark_app_image_tag: ''\nspark_history_server_path: ''\nspark_operator_version: spark-3\nstorage:\n auto_mount_params: ''\n auto_mount_type: auto\nsubmit_timeout: '180'\nui:\n projects_prefix: projects\n url: http://localhost:8060\nui_url: ''\nv3io_api: http://v3io-webapi:8081\nv3io_framesd: http://framesd:8080\nvalid_function_priority_class_names: ''\nversion: ''\n’, ‘version’: {‘git_commit’: ‘c34edd1ca4a16735e5e439c6caf25666e050369c’, ‘version’: ‘1.1.0’}} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:03,537 [info] Creating sql db desktopdockertools-jupyter-1 | > 2022-09-24 08:30:03,538 [info] Moving api to online desktopdockertools-jupyter-1 | > 2022-09-24 08:30:03,544 [info] Starting scheduler desktopdockertools-jupyter-1 | > 2022-09-24 08:30:03,546 [info] Reloading schedules desktopdockertools-jupyter-1 | > 2022-09-24 08:30:03,546 [debug] Getting schedules from db: {‘project’: None, ‘name’: None, ‘kind’: None} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:03,558 [info] Initializing projects leader desktopdockertools-jupyter-1 | > 2022-09-24 08:30:03,559 [debug] Initialized leader and followers: {‘leader’: ‘mlrun’, ‘followers’: []} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:03,570 [debug] Validating field against patterns: {‘field_name’: ‘project.metadata.name’, ‘field_value’: ‘test’, ‘pattern’: [‘^.{0,63}$’, ‘^a-z0-9?$’]} desktopdockertools-jupyter-1 | INFO: Application startup complete. desktopdockertools-jupyter-1 | INFO [uvicorn.error] Application startup complete. desktopdockertools-jupyter-1 | INFO: Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit) desktopdockertools-jupyter-1 | INFO [uvicorn.error] Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit) desktopdockertools-jupyter-1 | > 2022-09-24 08:30:19,252 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘172.19.0.1:42760’, ‘http_version’: ‘1.1’, ‘request_id’: ‘c6270325-9a10-47dc-8a73-52e61b6fb891’, ‘uri’: ‘/api/v1/projects’} desktopdockertools-jupyter-1 | [I 2022-09-24 08:30:19.260 ServerApp] 302 GET / (172.19.0.1) 1.24ms desktopdockertools-jupyter-1 | > 2022-09-24 08:30:19,291 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘c6270325-9a10-47dc-8a73-52e61b6fb891’, ‘uri’: ‘/api/v1/projects’, ‘method’: ‘GET’} desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:30:19 +0000] “GET /mlrun/config.json HTTP/1.1” 200 96 “http://localhost:8060/mlrun/” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-” desktopdockertools-jupyter-1 | > 2022-09-24 08:30:19,516 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘172.19.0.2:42674’, ‘http_version’: ‘1.0’, ‘request_id’: ‘41ce4a0d-624f-406c-9fb5-c6672fc0b1f3’, ‘uri’: ‘/api/v1/frontend-spec’} desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:30:19 +0000] “GET /mlrun/api/v1/frontend-spec HTTP/1.1” 200 1086 “http://localhost:8060/mlrun/projects” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-” desktopdockertools-jupyter-1 | > 2022-09-24 08:30:19,526 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘41ce4a0d-624f-406c-9fb5-c6672fc0b1f3’, ‘uri’: ‘/api/v1/frontend-spec’, ‘method’: ‘GET’} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:19,555 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘172.19.0.1:42760’, ‘http_version’: ‘1.1’, ‘request_id’: ‘b8191c32-3eef-4d76-95e7-e00a535a85ea’, ‘uri’: ‘/favicon.ico’} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:19,558 [debug] Sending response: {‘status_code’: 404, ‘request_id’: ‘b8191c32-3eef-4d76-95e7-e00a535a85ea’, ‘uri’: ‘/favicon.ico’, ‘method’: ‘GET’} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:19,596 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘172.19.0.2:42676’, ‘http_version’: ‘1.0’, ‘request_id’: ‘d9c9e8d7-738a-4a00-81be-7f20aaae3081’, ‘uri’: ‘/api/v1/projects’} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:19,606 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘172.19.0.2:42682’, ‘http_version’: ‘1.0’, ‘request_id’: ‘168e5822-f7bb-4d59-925d-a866ed1ad716’, ‘uri’: ‘/api/v1/projects?format=name_only’} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:19,614 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘172.19.0.2:42688’, ‘http_version’: ‘1.0’, ‘request_id’: ‘5c907027-2573-40b6-9f5d-2d16acabea13’, ‘uri’: ‘/api/v1/project-summaries’} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:19,643 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘d9c9e8d7-738a-4a00-81be-7f20aaae3081’, ‘uri’: ‘/api/v1/projects’, ‘method’: ‘GET’} desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:30:19 +0000] “GET /mlrun/api/v1/projects HTTP/1.1” 200 387 “http://localhost:8060/mlrun/projects” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-” desktopdockertools-jupyter-1 | > 2022-09-24 08:30:19,680 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘168e5822-f7bb-4d59-925d-a866ed1ad716’, ‘uri’: ‘/api/v1/projects?format=name_only’, ‘method’: ‘GET’} desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:30:19 +0000] “GET /mlrun/api/v1/projects?format=name_only HTTP/1.1” 200 21 “http://localhost:8060/mlrun/projects” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-” desktopdockertools-jupyter-1 | > 2022-09-24 08:30:19,696 [debug] Project resources counter cache expired. Calculating: {‘ttl’: datetime.datetime(1, 1, 1, 0, 0)} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:19,773 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘5c907027-2573-40b6-9f5d-2d16acabea13’, ‘uri’: ‘/api/v1/project-summaries’, ‘method’: ‘GET’} desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:30:19 +0000] “GET /mlrun/api/v1/project-summaries HTTP/1.1” 200 195 “http://localhost:8060/mlrun/projects” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-” desktopdockertools-jupyter-1 | [I 2022-09-24 08:30:22.418 LabApp] Build is up to date desktopdockertools-jupyter-1 | [W 2022-09-24 08:30:28.627 ServerApp] Notebook Practical_Exercises_01.ipynb is not trusted desktopdockertools-jupyter-1 | [I 2022-09-24 08:30:29.074 ServerApp] Kernel started: 5570c03f-45c6-4849-9cc6-5b07770bd7ec desktopdockertools-jupyter-1 | [I 2022-09-24 08:30:29.093 ServerApp] Kernel started: 71400ff1-aa9a-47ce-a834-2b97fea6b01e desktopdockertools-mlrun-ui-1 | 2022/09/24 08:30:30 [error] 11#11: 1 nuclio could not be resolved (3: Host not found), client: 172.19.0.1, server: , request: “GET /mlrun/nuclio/api/functions HTTP/1.1”, host: “localhost:8060”, referrer: “http://localhost:8060/mlrun/projects” desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:30:30 +0000] “GET /mlrun/nuclio/api/functions HTTP/1.1” 502 497 “http://localhost:8060/mlrun/projects” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-” desktopdockertools-jupyter-1 | [E 2022-09-24 08:30:31.699 ServerApp] Uncaught exception GET /api/nbconvert?1664008221815 (172.19.0.1) desktopdockertools-jupyter-1 | HTTPServerRequest(protocol=‘http’, host=‘localhost:8888’, method=‘GET’, uri=‘/api/nbconvert?1664008221815’, version=‘HTTP/1.1’, remote_ip=‘172.19.0.1’) desktopdockertools-jupyter-1 | Traceback (most recent call last): desktopdockertools-jupyter-1 | File “/opt/conda/lib/python3.8/site-packages/tornado/web.py”, line 1704, in _execute desktopdockertools-jupyter-1 | result = await result desktopdockertools-jupyter-1 | File “/opt/conda/lib/python3.8/site-packages/jupyter_server/services/nbconvert/handlers.py”, line 48, in get desktopdockertools-jupyter-1 | self.finish(json.dumps(res)) desktopdockertools-jupyter-1 | File “/opt/conda/lib/python3.8/json/init.py”, line 231, in dumps desktopdockertools-jupyter-1 | return _default_encoder.encode(obj) desktopdockertools-jupyter-1 | File “/opt/conda/lib/python3.8/json/encoder.py”, line 199, in encode desktopdockertools-jupyter-1 | chunks = self.iterencode(o, _one_shot=True) desktopdockertools-jupyter-1 | File “/opt/conda/lib/python3.8/json/encoder.py”, line 257, in iterencode desktopdockertools-jupyter-1 | return _iterencode(o, 0) desktopdockertools-jupyter-1 | File “/opt/conda/lib/python3.8/json/encoder.py”, line 179, in default desktopdockertools-jupyter-1 | raise TypeError(f’Object of type {o.class.name} ’ desktopdockertools-jupyter-1 | TypeError: Object of type property is not JSON serializable desktopdockertools-jupyter-1 | [W 2022-09-24 08:30:31.703 ServerApp] Unhandled error desktopdockertools-jupyter-1 | [E 2022-09-24 08:30:31.704 ServerApp] { desktopdockertools-jupyter-1 | “Host”: “localhost:8888”, desktopdockertools-jupyter-1 | “Accept”: "/", desktopdockertools-jupyter-1 | “Referer”: “http://localhost:8888/lab?”, desktopdockertools-jupyter-1 | “User-Agent”: “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” desktopdockertools-jupyter-1 | } desktopdockertools-jupyter-1 | [E 2022-09-24 08:30:31.704 ServerApp] 500 GET /api/nbconvert?1664008221815 (172.19.0.1) 9563.66ms referer=http://localhost:8888/lab? desktopdockertools-jupyter-1 | [E 2022-09-24 08:30:32.022 ServerApp] Uncaught exception GET /api/nbconvert?1664008221839 (172.19.0.1) desktopdockertools-jupyter-1 | HTTPServerRequest(protocol=‘http’, host=‘localhost:8888’, method=‘GET’, uri=’/api/nbconvert?1664008221839’, version=‘HTTP/1.1’, remote_ip=‘172.19.0.1’) desktopdockertools-jupyter-1 | Traceback (most recent call last): desktopdockertools-jupyter-1 | File “/opt/conda/lib/python3.8/site-packages/tornado/web.py”, line 1704, in _execute desktopdockertools-jupyter-1 | result = await result desktopdockertools-jupyter-1 | File “/opt/conda/lib/python3.8/site-packages/jupyter_server/services/nbconvert/handlers.py”, line 48, in get desktopdockertools-jupyter-1 | self.finish(json.dumps(res)) desktopdockertools-jupyter-1 | File “/opt/conda/lib/python3.8/json/init.py”, line 231, in dumps desktopdockertools-jupyter-1 | return _default_encoder.encode(obj) desktopdockertools-jupyter-1 | File “/opt/conda/lib/python3.8/json/encoder.py”, line 199, in encode desktopdockertools-jupyter-1 | chunks = self.iterencode(o, _one_shot=True) desktopdockertools-jupyter-1 | File “/opt/conda/lib/python3.8/json/encoder.py”, line 257, in iterencode desktopdockertools-jupyter-1 | return _iterencode(o, 0) desktopdockertools-jupyter-1 | File “/opt/conda/lib/python3.8/json/encoder.py”, line 179, in default desktopdockertools-jupyter-1 | raise TypeError(f’Object of type {o.class.name} ’ desktopdockertools-jupyter-1 | TypeError: Object of type property is not JSON serializable desktopdockertools-jupyter-1 | [W 2022-09-24 08:30:32.023 ServerApp] Unhandled error desktopdockertools-jupyter-1 | [E 2022-09-24 08:30:32.024 ServerApp] { desktopdockertools-jupyter-1 | “Host”: “localhost:8888”, desktopdockertools-jupyter-1 | “Accept”: “/”, desktopdockertools-jupyter-1 | “Referer”: “http://localhost:8888/lab?”, desktopdockertools-jupyter-1 | “User-Agent”: “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” desktopdockertools-jupyter-1 | } desktopdockertools-jupyter-1 | [E 2022-09-24 08:30:32.025 ServerApp] 500 GET /api/nbconvert?1664008221839 (172.19.0.1) 9883.44ms referer=http://localhost:8888/lab? desktopdockertools-jupyter-1 | > 2022-09-24 08:30:40,659 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘172.19.0.2:42828’, ‘http_version’: ‘1.0’, ‘request_id’: ‘b850bff4-45fd-41d8-9566-bea5a9047fb9’, ‘uri’: ‘/api/v1/projects/test’} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:40,667 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘172.19.0.2:42834’, ‘http_version’: ‘1.0’, ‘request_id’: ‘1f899836-562d-4989-ada2-b0abaadbc60f’, ‘uri’: ‘/api/v1/project-summaries/test’} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:40,695 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘b850bff4-45fd-41d8-9566-bea5a9047fb9’, ‘uri’: ‘/api/v1/projects/test’, ‘method’: ‘GET’} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:40,695 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘1f899836-562d-4989-ada2-b0abaadbc60f’, ‘uri’: ‘/api/v1/project-summaries/test’, ‘method’: ‘GET’} desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:30:40 +0000] “GET /mlrun/api/v1/projects/test HTTP/1.1” 200 372 “http://localhost:8060/mlrun/projects/test/monitor” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-” desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:30:40 +0000] “GET /mlrun/api/v1/project-summaries/test HTTP/1.1” 200 171 “http://localhost:8060/mlrun/projects/test/monitor” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-” desktopdockertools-jupyter-1 | > 2022-09-24 08:30:40,751 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘172.19.0.2:42836’, ‘http_version’: ‘1.0’, ‘request_id’: ‘13aef804-dbaf-457e-bc11-119ee4db01f8’, ‘uri’: ‘/api/v1/runs?project=test&partition-by=name&partition-sort-by=updated&rows-per-partition=5&max-partitions=5&iter=false’} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:40,797 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘13aef804-dbaf-457e-bc11-119ee4db01f8’, ‘uri’: ‘/api/v1/runs?project=test&partition-by=name&partition-sort-by=updated&rows-per-partition=5&max-partitions=5&iter=false’, ‘method’: ‘GET’} desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:30:40 +0000] “GET /mlrun/api/v1/runs?project=test&partition-by=name&partition-sort-by=updated&rows-per-partition=5&max-partitions=5&iter=false HTTP/1.1” 200 11 “http://localhost:8060/mlrun/projects/test/monitor” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-” desktopdockertools-jupyter-1 | > 2022-09-24 08:30:42,460 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘172.19.0.2:42842’, ‘http_version’: ‘1.0’, ‘request_id’: ‘99225e84-2e84-4638-92b7-2f41e99bd010’, ‘uri’: ‘/api/v1/projects/test/feature-sets/%2A/tags’} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:42,476 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘172.19.0.2:42848’, ‘http_version’: ‘1.0’, ‘request_id’: ‘c948f7b7-1902-453a-b463-2fcbe823ea7c’, ‘uri’: ‘/api/v1/projects/test/feature-sets?tag=latest’} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:42,500 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘99225e84-2e84-4638-92b7-2f41e99bd010’, ‘uri’: ‘/api/v1/projects/test/feature-sets/%2A/tags’, ‘method’: ‘GET’} desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:30:42 +0000] “GET /mlrun/api/v1/projects/test/feature-sets/*/tags HTTP/1.1” 200 19 “http://localhost:8060/mlrun/projects/test/feature-store/feature-sets” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-” desktopdockertools-jupyter-1 | > 2022-09-24 08:30:42,524 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘c948f7b7-1902-453a-b463-2fcbe823ea7c’, ‘uri’: ‘/api/v1/projects/test/feature-sets?tag=latest’, ‘method’: ‘GET’} desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:30:42 +0000] “GET /mlrun/api/v1/projects/test/feature-sets?tag=latest HTTP/1.1” 200 750 “http://localhost:8060/mlrun/projects/test/feature-store/feature-sets” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-” desktopdockertools-jupyter-1 | > 2022-09-24 08:30:53,493 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘127.0.0.1:42958’, ‘http_version’: ‘1.1’, ‘request_id’: ‘581dd519-7d22-4c55-a6bd-43b5df71d293’, ‘uri’: ‘/api/v1/client-spec’} desktopdockertools-jupyter-1 | > 2022-09-24 08:30:58,501 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘127.0.0.1:42968’, ‘http_version’: ‘1.1’, ‘request_id’: ‘b6fe393e-587a-407a-bac6-845997db4f28’, ‘uri’: ‘/api/v1/client-spec’} desktopdockertools-jupyter-1 | WARNI [urllib3.connectionpool] Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6ebb0f4220>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’)‘: /api/versions desktopdockertools-jupyter-1 | > 2022-09-24 08:31:05,510 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘127.0.0.1:42970’, ‘http_version’: ‘1.1’, ‘request_id’: ‘9fefd412-35b7-44eb-9332-e540849afc22’, ‘uri’: ‘/api/v1/client-spec’} desktopdockertools-jupyter-1 | WARNI [urllib3.connectionpool] Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb98cca30>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’)‘: /api/versions desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:31:10 +0000] “GET /mlrun/nuclio/api/functions HTTP/1.1” 502 497 “http://localhost:8060/mlrun/projects/test/monitor” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-” desktopdockertools-mlrun-ui-1 | 2022/09/24 08:31:10 [error] 15#15: *13 nuclio could not be resolved (110: Operation timed out), client: 172.19.0.1, server: , request: “GET /mlrun/nuclio/api/functions HTTP/1.1”, host: “localhost:8060”, referrer: “http://localhost:8060/mlrun/projects/test/monitor” desktopdockertools-mlrun-ui-1 | 2022/09/24 08:31:10 [error] 17#17: *20 nuclio could not be resolved (110: Operation timed out), client: 172.19.0.1, server: , request: “GET /mlrun/nuclio/api/api_gateways HTTP/1.1”, host: “localhost:8060”, referrer: “http://localhost:8060/mlrun/projects/test/monitor” desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:31:10 +0000] “GET /mlrun/nuclio/api/api_gateways HTTP/1.1” 502 497 “http://localhost:8060/mlrun/projects/test/monitor” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-” desktopdockertools-jupyter-1 | > 2022-09-24 08:31:14,521 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘127.0.0.1:42972’, ‘http_version’: ‘1.1’, ‘request_id’: ‘e4feb289-15fa-42a7-8691-1633e2f2dfe2’, ‘uri’: ‘/api/v1/client-spec’} desktopdockertools-jupyter-1 | WARNI [urllib3.connectionpool] Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb98ccb20>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’)‘: /api/versions desktopdockertools-jupyter-1 | WARNI [urllib3.connectionpool] Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb987d040>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’)‘: /api/versions desktopdockertools-jupyter-1 | > 2022-09-24 08:31:20,336 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘172.19.0.2:42870’, ‘http_version’: ‘1.0’, ‘request_id’: ‘d5800873-4b94-4270-aba0-22ae4e2af629’, ‘uri’: ‘/api/v1/frontend-spec’} desktopdockertools-jupyter-1 | > 2022-09-24 08:31:20,343 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘d5800873-4b94-4270-aba0-22ae4e2af629’, ‘uri’: ‘/api/v1/frontend-spec’, ‘method’: ‘GET’} desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:31:20 +0000] “GET /mlrun/api/v1/frontend-spec HTTP/1.1” 200 1086 “http://localhost:8060/mlrun/projects/test/feature-store/feature-sets” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-” desktopdockertools-jupyter-1 | WARNI [urllib3.connectionpool] Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb987d250>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’)‘: /api/versions desktopdockertools-jupyter-1 | WARNI [urllib3.connectionpool] Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb98876a0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’)‘: /api/versions desktopdockertools-jupyter-1 | WARNI [urllib3.connectionpool] Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb9887af0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’)‘: /api/versions desktopdockertools-jupyter-1 | WARNI [urllib3.connectionpool] Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb98878e0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’)‘: /api/versions desktopdockertools-jupyter-1 | WARNI [urllib3.connectionpool] Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb9895fd0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’)‘: /api/versions desktopdockertools-jupyter-1 | WARNI [urllib3.connectionpool] Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb9895520>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’)‘: /api/versions desktopdockertools-jupyter-1 | > 2022-09-24 08:31:39,551 [warning] Failed to resolve nuclio version: {‘exc’: "HTTPConnectionPool(host=‘nuclio’, port=8070): Max retries exceeded with url: /api/versions (Caused by NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb9887d00>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’))“} desktopdockertools-jupyter-1 | > 2022-09-24 08:31:39,556 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘581dd519-7d22-4c55-a6bd-43b5df71d293’, ‘uri’: ‘/api/v1/client-spec’, ‘method’: ‘GET’} desktopdockertools-jupyter-1 | WARNI [urllib3.connectionpool] Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb9887f10>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’)‘: /api/versions desktopdockertools-jupyter-1 | > 2022-09-24 08:31:44,557 [warning] Failed to resolve nuclio version: {‘exc’: "HTTPConnectionPool(host=‘nuclio’, port=8070): Max retries exceeded with url: /api/versions (Caused by NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb9895b20>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’))”} desktopdockertools-jupyter-1 | > 2022-09-24 08:31:44,560 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘b6fe393e-587a-407a-bac6-845997db4f28’, ‘uri’: ‘/api/v1/client-spec’, ‘method’: ‘GET’} desktopdockertools-jupyter-1 | WARNI [urllib3.connectionpool] Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb98956a0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’)‘: /api/versions desktopdockertools-jupyter-1 | > 2022-09-24 08:31:51,574 [warning] Failed to resolve nuclio version: {‘exc’: "HTTPConnectionPool(host=‘nuclio’, port=8070): Max retries exceeded with url: /api/versions (Caused by NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb9887d30>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’))“} desktopdockertools-jupyter-1 | > 2022-09-24 08:31:51,579 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘9fefd412-35b7-44eb-9332-e540849afc22’, ‘uri’: ‘/api/v1/client-spec’, ‘method’: ‘GET’} desktopdockertools-jupyter-1 | > 2022-09-24 08:31:56,352 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘172.19.0.1:42982’, ‘http_version’: ‘1.1’, ‘request_id’: ‘1fbba145-1df0-4924-a6c2-17d283149179’, ‘uri’: ‘/api/v1/client-spec’} desktopdockertools-jupyter-1 | > 2022-09-24 08:32:00,578 [warning] Failed to resolve nuclio version: {‘exc’: “HTTPConnectionPool(host=‘nuclio’, port=8070): Max retries exceeded with url: /api/versions (Caused by NewConnectionError(‘<urllib3.connection.HTTPConnection object at 0x7f6eb98c3b20>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’))”} desktopdockertools-jupyter-1 | > 2022-09-24 08:32:00,581 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘e4feb289-15fa-42a7-8691-1633e2f2dfe2’, ‘uri’: ‘/api/v1/client-spec’, ‘method’: ‘GET’} desktopdockertools-jupyter-1 | WARNI [urllib3.connectionpool] Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb9827370>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’)‘: /api/versions desktopdockertools-jupyter-1 | WARNI [urllib3.connectionpool] Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb987d6d0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’)‘: /api/versions desktopdockertools-jupyter-1 | > 2022-09-24 08:32:20,332 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘172.19.0.2:42880’, ‘http_version’: ‘1.0’, ‘request_id’: ‘f2189d4c-feae-40fc-b5c4-918f55c4bbdd’, ‘uri’: ‘/api/v1/frontend-spec’} desktopdockertools-jupyter-1 | > 2022-09-24 08:32:20,340 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘f2189d4c-feae-40fc-b5c4-918f55c4bbdd’, ‘uri’: ‘/api/v1/frontend-spec’, ‘method’: ‘GET’} desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:32:20 +0000] “GET /mlrun/api/v1/frontend-spec HTTP/1.1” 200 1086 “http://localhost:8060/mlrun/projects/test/feature-store/feature-sets” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-” desktopdockertools-jupyter-1 | [I 2022-09-24 08:32:29.018 ServerApp] Saving file at /Untitled.ipynb desktopdockertools-jupyter-1 | WARNI [urllib3.connectionpool] Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb987ddf0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’)‘: /api/versions desktopdockertools-jupyter-1 | > 2022-09-24 08:32:42,412 [warning] Failed to resolve nuclio version: {‘exc’: "HTTPConnectionPool(host=‘nuclio’, port=8070): Max retries exceeded with url: /api/versions (Caused by NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x7f6eb9827be0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution’))”} desktopdockertools-jupyter-1 | > 2022-09-24 08:32:42,417 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘1fbba145-1df0-4924-a6c2-17d283149179’, ‘uri’: ‘/api/v1/client-spec’, ‘method’: ‘GET’} desktopdockertools-jupyter-1 | > 2022-09-24 08:33:20,340 [debug] Received request: {‘method’: ‘GET’, ‘client_address’: ‘172.19.0.2:42882’, ‘http_version’: ‘1.0’, ‘request_id’: ‘03563408-9081-4655-9cac-148eea489560’, ‘uri’: ‘/api/v1/frontend-spec’} desktopdockertools-jupyter-1 | > 2022-09-24 08:33:20,346 [debug] Sending response: {‘status_code’: 200, ‘request_id’: ‘03563408-9081-4655-9cac-148eea489560’, ‘uri’: ‘/api/v1/frontend-spec’, ‘method’: ‘GET’} desktopdockertools-mlrun-ui-1 | 172.19.0.1 - - [24/Sep/2022:08:33:20 +0000] “GET /mlrun/api/v1/frontend-spec HTTP/1.1” 200 1086 “http://localhost:8060/mlrun/projects/test/feature-store/feature-sets” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Edg/105.0.1343.42” “-”

Additional Information

Note: It can maybe has relation that I tested mlrun in docker with jupyter notebook and also without jupyter notebook (I tested a few configurations for me colleague)

[liranbg]

@Tankilevitch, what do you think, makes it sense to mention this point to documentation or it is more than clear?

To be honest, I dont think this is required. I would consider it very basic to understand that if service allocate port X, then no other service can expose/allocat on same port.

[Tankilevitch]

Hey @george0st indeed seems like a conflict between two installations. which both are trying to expose 8080 port.

If you wish to have two or more installation on one computer, you can change in the docker-compose the ports that each service is exposing.