question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

kedro-mlflow CLI is unavailable inside a Kedro project

See original GitHub issue

Description

I try to reproduce the minimal example from the Docs: a Kedro project using the starter pandas-iris using the kedro-mlflow functinality. I do not arrive at initializing the kedro-mlflow project, since the cli commands are not available.

Context

It is unclear to me if this is connected to #157 I wanted to start looking into kedro-mlflow, but got immediatle blocked by the initialization of the project. Therefore any advice on where to look to fix this would also be appreciated.

Steps to Reproduce

conda create -n kedro_mlflow python=3.8
conda activate kedro_mlflow
pip install kedro-mlflow
kedro mlflow -h
kedro new --starter=pandas-iris
cd mlflow_test/
kedro mlflow -h
> ERROR "No such command 'mlflow'"

Expected Result

kedro mlflow is available in a project directory, i.e. kedro mlflow -h gives the same output inside the folder as before

Actual Result

inside the project folder the mlflow command is unknown to Kedro

.../miniconda3/envs/kedro_mlflow/lib/python3.8/site-packages/pkg_resources/__init__.py:1130: DeprecationWarning: Use of .. or absolute path in a resource path is not allowed and will raise exceptions in a future release.
  return get_provider(package_or_requirement).get_resource_filename(
..../miniconda3/envs/kedro_mlflow/lib/python3.8/site-packages/mlflow/types/schema.py:49: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  binary = (7, np.dtype("bytes"), "BinaryType", np.object)
2021-04-23 17:49:52,197 - root - INFO - Registered hooks from 2 installed plugin(s): kedro-mlflow-0.7.1
Usage: kedro [OPTIONS] COMMAND [ARGS]...
Try 'kedro -h' for help.

Error: No such command 'mlflow'.

Your Environment

Ubuntu 18.04.5

  • Kedro 0.17.3
  • kedro-mlflow 0.7.1
  • python 3.8.8.
  • mlflow 1.15.0

Does the bug also happen with the last version on master?

yes

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Reactions:2
  • Comments:6 (4 by maintainers)

github_iconTop GitHub Comments

3reactions
dmb23commented, Apr 26, 2021

First of all, thank you for looking so quickly into it!

From how I read your second message you already know that, but to answer your questions:

  • detecting kedro mlflow works fine with kedro==0.17.2
  • the problem is consistent with kedro==0.17.3 independent if I use the pandas-iris starter or not
  • kedro viz is found also with kedro=0.17.3

Again, thank you for providing workarounds directly on Monday morning, I can nicely work with those! A question for my understanding of the plugin: As long as the hooks are loaded, the mlflow functionality depends only on a mlflow.yml to be present, and all that kedro mlflow init does is copy this file from the template into conf/local, is this correct?

2reactions
Galileo-Galileicommented, May 2, 2021

Hi @dmb23, I’ve just deployed the patch to PyPI. You can use `pip install kedro_mlflow==0.7.2`` and it should be ok for now. I close the issue, but feel free to reopen if you still encounter any issue in this new version.

Read more comments on GitHub >

github_iconTop Results From Across the Web

CLI — kedro-mlflow 0.11.5 documentation
Opens the mlflow user interface with the project-specific settings of mlflow.yml. ... Available pipelines can be listed with in 'kedro registry list'.
Read more >
kedro-mlflow - Release 0.11.4 Yolan Honoré-Rougé
Mlflow Projects: This module provides a configuration files and CLI to enable reproducible execution of pipelines in production phase.
Read more >
Kedro's command line interface - Read the Docs
The following command deletes all the files related to a modular pipeline in your Kedro project. kedro pipeline delete <pipeline_name> Copy to clipboard....
Read more >
Kedro plugins — Kedro 0.18.4 documentation
Plugins may also add commands to the Kedro CLI, which supports two types of commands: global - available both inside and outside a...
Read more >
Kedro plugins — Kedro 0.18.1 documentation
Plugins may also add commands to the Kedro CLI, which supports two types of commands: global - available both inside and outside a...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found