[BUG] FileNotFoundError: [WinError 2] The system cannot find the file specified when running mlflow pipelines run --profile local

Willingness to contribute

No. I cannot contribute a bug fix at this time.

MLflow version

1.27.0

System information

• OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Windows 10 Pro (64 bit)
• Python version: 3.7.13 (also tried 3.8)
• yarn version, if running the dev UI:

Describe the problem

Following the tutorials for the new MLflow Pipelines https://mlflow.org/docs/latest/pipelines.html and https://github.com/mlflow/mlp-regression-template. Just trying to get the template example to run.

Not sure if related but… if I try running the Jupyter Notebook example from the template, it can’t find the module: ModuleNotFoundError: No module named ‘mlflow.pipelines’ (imports fine if I try from Python CLI in Anaconda Prompt)

Tracking information

No response

Code to reproduce issue

1. Started a new conda env with “conda create -n mlflowpipelines python=3.7”
2. Activated env with “conda activate mlflowpipelines”
3. Cloned template with “git clone https://github.com/mlflow/mlp-regression-template.git”
4. Changed into dir with “cd mlp-regression-template”
5. Installed dependencies with “pip install -r requirements.txt”
6. Ran “mlflow pipelines run --profile local”

Other info / logs

2022/07/06 11:37:50 INFO mlflow.pipelines.pipeline: Creating MLflow Pipeline 'mlp-regression-template' with profile: 'local'
Traceback (most recent call last):
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\Scripts\mlflow.exe\__main__.py", line 7, in <module>
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\site-packages\click\core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\site-packages\click\core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\site-packages\click\core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\site-packages\click\core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\site-packages\click\core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\site-packages\click\core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\site-packages\mlflow\pipelines\cli.py", line 46, in run
    Pipeline(profile=profile).run(step)
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\site-packages\mlflow\pipelines\regression\v1\pipeline.py", line 337, in run
    return super().run(step=step)
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\site-packages\mlflow\pipelines\pipeline.py", line 79, in run
    self._get_step(step) if step else self._steps[-1],
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\site-packages\mlflow\pipelines\utils\execution.py", line 74, in run_pipeline_step
    extra_env=make_env,
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\site-packages\mlflow\pipelines\utils\execution.py", line 285, in _run_make
    extra_env=extra_env,
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\site-packages\mlflow\utils\process.py", line 98, in _exec_cmd
    **kwargs,
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\subprocess.py", line 800, in __init__
    restore_signals, start_new_session)
  File "C:\Users\Vizer\Anaconda3\envs\mlflowpipelines\lib\subprocess.py", line 1207, in _execute_child
    startupinfo)
FileNotFoundError: [WinError 2] The system cannot find the file specified

What component(s) does this bug affect?

• area/artifacts: Artifact stores and artifact logging
• area/build: Build and test infrastructure for MLflow
• area/docs: MLflow documentation pages
• area/examples: Example code
• area/model-registry: Model Registry service, APIs, and the fluent client calls for Model Registry
• area/models: MLmodel format, model serialization/deserialization, flavors
• area/pipelines: Pipelines, Pipeline APIs, Pipeline configs, Pipeline Templates
• area/projects: MLproject format, project running backends
• area/scoring: MLflow Model server, model deployment tools, Spark UDFs
• area/server-infra: MLflow Tracking server backend
• area/tracking: Tracking Service, tracking client APIs, autologging

What interface(s) does this bug affect?

• area/uiux: Front-end, user experience, plotting, JavaScript, JavaScript dev server
• area/docker: Docker use across MLflow’s components, such as MLflow Projects and MLflow Models
• area/sqlalchemy: Use of SQLAlchemy in the Tracking Service or Model Registry
• area/windows: Windows support

What language(s) does this bug affect?

• language/r: R APIs and clients
• language/java: Java APIs and clients
• language/new: Proposals for new client languages

What integration(s) does this bug affect?

• integrations/azure: Azure and Azure ML integrations
• integrations/sagemaker: SageMaker integrations
• integrations/databricks: Databricks integrations

[harupy]

@dbczumar It might be helpful to check if make is available and throw an error with a helpful message if it’s not.

[OSobky]

I was trying out MLflow pipelines yesterday and I faced the same problem. I see @dbczumar already merged a PR to solve this problem. Maybe also consider adding this note in the Regression Template so it is clear everywhere.