[SETUP-BUG] Issue in pip dependency resolution of test-requirements.txt

Thank you for submitting an issue. Please refer to our issue policy for information on what types of issues we address.

Please fill in this installation issue template to ensure a timely and thorough response.

System information

• OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Windows 11
• MLflow installed from (source or binary): NA
• MLflow version (run mlflow --version): NA
• Python version: 3.6.13
• Exact command to reproduce:

conda create --name mlflow-dev-env python=3.6 conda activate mlflow-dev-env pip install -r dev-requirements.txt pip install -r test-requirements.txt

Describe the problem

Provide the exact sequence of commands / steps that you executed before running into the problem.

The setup step ran fine till dev-requirements.txt, but when i ran for test-requirements.txt, pip setup runs for hours but never finishes, it was downloading all the versions of almost all libraries. I could see lots of messages like “pip is looking at multiple versions of <library_name>” for many libraries. When i tried to use pip-compile test-requirements.txt as suggested in https://stackoverflow.com/questions/65122957/resolving-new-pip-backtracking-runtime-issue, I’m getting the below error

Could not find a version that matches gast==0.3.3,==0.4.0 (from tensorflow==2.6.1->-r dev/extra-ml-requirements.txt (line 18)) Tried: 0.1, 0.1.1, 0.1.2, 0.1.3, 0.1.4, 0.1.5, 0.2.0, 0.2.1, 0.2.1.post0, 0.2.1.post1, 0.2.2, 0.3.0, 0.3.1, 0.3.2, 0.3.3, 0.3.3, 0.4.0, 0.4.0, 0.5.0, 0.5.0, 0.5.1, 0.5.1, 0.5.2, 0.5.2 There are incompatible versions in the resolved dependencies: gast==0.4.0 (from tensorflow==2.6.1->-r dev/extra-ml-requirements.txt (line 18)) gast==0.3.3 (from paddlepaddle==2.1.3->-r dev/extra-ml-requirements.txt (line 44))

Please let me know how to resolve this issue.

Other info / logs

Include any logs or source code that would be helpful to diagnose the problem. If including tracebacks, please include the full traceback. Large logs and files should be attached.

[mhemendra]

By downgrading the pylint to 2.10.0, i was able to successfully run the pip-compile command. So i was able to generate the dependencies properly by making below changes mxnet == 1.2.0 tensorflow=2.4.4 and pylint >= 2.1.0

PFA the requirements.txt generated by the pip-compile command. requirements.txt

Can we update the documentation to use the pip-compile command to generate requirements.txt, otherwise lots of pip backtracking issues occur during the installation of test-requirements.txt.

[alonisser]

Ping?