Demucs No-Longer Installable via PIP Since Python 3.10

🐛 Bug Report

I don’t think I’m doing anything stupid here. Demucs worked fine with Python 3.9 and happily installed via PIP. But since Python 3.10 came out, it doesn’t appear to work via PIP anymore.

To Reproduce

Run “python -m pip install -U demucs” or “pip install demucs”

Expected behavior

To get the usual PIP installation progress bars, messages and for it to install with dependencies.

Actual Behavior

A lot of errors:

Collecting demucs
  Using cached demucs-3.0.3.tar.gz (1.5 MB)
WARNING: Discarding https://files.pythonhosted.org/packages/17/24/3b75e03243651603b95d8dbdb99eba104a464d3e8ca26d1ad54d95a985c5/demucs-3.0.3.tar.gz#sha256=c779a75537088bef53e96d67c5a999b5a9189d82ea78d9440df718ba3a318308 (from https://pypi.org/simple/demucs/) (requires-python:>=3.7.0). Requested demucs from https://files.pythonhosted.org/packages/17/24/3b75e03243651603b95d8dbdb99eba104a464d3e8ca26d1ad54d95a985c5/demucs-3.0.3.tar.gz#sha256=c779a75537088bef53e96d67c5a999b5a9189d82ea78d9440df718ba3a318308 has different version in metadata: '3.0.3'
  Using cached demucs-3.0.2.tar.gz (1.5 MB)
WARNING: Discarding https://files.pythonhosted.org/packages/6b/ed/61e40fe1d1b43507d2d4d5981711d556504bab18876c2474ae5e0751e9e3/demucs-3.0.2.tar.gz#sha256=757dd6a5cdbf548f33940f9b5838f3187f1711c58ef25f3c2f08bcd51de1e7a7 (from https://pypi.org/simple/demucs/) (requires-python:>=3.7.0). Requested demucs from https://files.pythonhosted.org/packages/6b/ed/61e40fe1d1b43507d2d4d5981711d556504bab18876c2474ae5e0751e9e3/demucs-3.0.2.tar.gz#sha256=757dd6a5cdbf548f33940f9b5838f3187f1711c58ef25f3c2f08bcd51de1e7a7 has different version in metadata: '3.0.2'
  Using cached demucs-3.0.1.tar.gz (1.5 MB)
WARNING: Discarding https://files.pythonhosted.org/packages/5b/93/8a96140c92b11f7928008187a37b4378129510be0d1dcdcb289ddfe258f3/demucs-3.0.1.tar.gz#sha256=54c4897bbce99e043137199ec9373f4447e3e88fc3f8c5ade2409a51c7f9ae86 (from https://pypi.org/simple/demucs/) (requires-python:>=3.7.0). Requested demucs from https://files.pythonhosted.org/packages/5b/93/8a96140c92b11f7928008187a37b4378129510be0d1dcdcb289ddfe258f3/demucs-3.0.1.tar.gz#sha256=54c4897bbce99e043137199ec9373f4447e3e88fc3f8c5ade2409a51c7f9ae86 has different version in metadata: '3.0.1'
  Using cached demucs-3.0.0.tar.gz (1.5 MB)
    ERROR: Command errored out with exit status 1:
     command: /usr/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-sz3n7y4o/demucs_22b643e65a08480b9bde7f8285820c1b/setup.py'"'"'; __file__='"'"'/tmp/pip-install-sz3n7y4o/demucs_22b643e65a08480b9bde7f8285820c1b/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-4322nv3r
         cwd: /tmp/pip-install-sz3n7y4o/demucs_22b643e65a08480b9bde7f8285820c1b/
    Complete output (7 lines):
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-sz3n7y4o/demucs_22b643e65a08480b9bde7f8285820c1b/setup.py", line 39, in <module>
        REQUIRED = load_requirements('requirements_minimal.txt')
      File "/tmp/pip-install-sz3n7y4o/demucs_22b643e65a08480b9bde7f8285820c1b/setup.py", line 34, in load_requirements
        required = [i.strip() for i in open(HERE / name)]
    FileNotFoundError: [Errno 2] No such file or directory: '/tmp/pip-install-sz3n7y4o/demucs_22b643e65a08480b9bde7f8285820c1b/requirements_minimal.txt'
    ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/5b/a5/d29ca8f45f1d6dc814d595b9874cb209d45e97c1bbfb41c48968be2e1231/demucs-3.0.0.tar.gz#sha256=d91beb476dfec0362a531a935429f429f3f8dae0d0772da3efb4fad73e9116d2 (from https://pypi.org/simple/demucs/) (requires-python:>=3.7.0). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
  Using cached demucs-2.0.3.tar.gz (51 kB)
WARNING: Discarding https://files.pythonhosted.org/packages/48/91/c6594847bc3ab99597f58acdb99c022cfe1d6027353e695778dd90301128/demucs-2.0.3.tar.gz#sha256=f7a8c0cdc9be24d7d8d0e826e64e5ea1cd7a7aa8a3032fe786b932fd7b4ffcce (from https://pypi.org/simple/demucs/) (requires-python:>=3.7.0). Requested demucs from https://files.pythonhosted.org/packages/48/91/c6594847bc3ab99597f58acdb99c022cfe1d6027353e695778dd90301128/demucs-2.0.3.tar.gz#sha256=f7a8c0cdc9be24d7d8d0e826e64e5ea1cd7a7aa8a3032fe786b932fd7b4ffcce has different version in metadata: '2.0.3'
  Using cached demucs-2.0.2.tar.gz (51 kB)
WARNING: Discarding https://files.pythonhosted.org/packages/ee/8b/8f3246b5b21cc137c02aeaf9cbeff2a6d1f65aafdb325f11aecc13ba07c3/demucs-2.0.2.tar.gz#sha256=0ca2ee067604915265db990b231fa9ad56c75bf51c12df0c4cec611f31f03bc2 (from https://pypi.org/simple/demucs/) (requires-python:>=3.7.0). Requested demucs from https://files.pythonhosted.org/packages/ee/8b/8f3246b5b21cc137c02aeaf9cbeff2a6d1f65aafdb325f11aecc13ba07c3/demucs-2.0.2.tar.gz#sha256=0ca2ee067604915265db990b231fa9ad56c75bf51c12df0c4cec611f31f03bc2 has different version in metadata: '2.0.2'
  Using cached demucs-2.0.1.tar.gz (51 kB)
WARNING: Discarding https://files.pythonhosted.org/packages/3b/37/5e853b339c193ce4d6bf47f1c1766ee938c1976eedec0ff9461d9c0b8e10/demucs-2.0.1.tar.gz#sha256=82448b6a57854150f793da407df41dc14102b2923682a10a4457765ea086501b (from https://pypi.org/simple/demucs/) (requires-python:>=3.7.0). Requested demucs from https://files.pythonhosted.org/packages/3b/37/5e853b339c193ce4d6bf47f1c1766ee938c1976eedec0ff9461d9c0b8e10/demucs-2.0.1.tar.gz#sha256=82448b6a57854150f793da407df41dc14102b2923682a10a4457765ea086501b has different version in metadata: '2.0.1'
  Using cached demucs-2.0.0.tar.gz (45 kB)
WARNING: Discarding https://files.pythonhosted.org/packages/80/77/4991edb8d4764892260a913048ee607b50da520c4638f2c824ce1bdbe30e/demucs-2.0.0.tar.gz#sha256=a7dac70f14c03163739ba3da59028aae889548c0f6f9f9780b8fa8e43b319b99 (from https://pypi.org/simple/demucs/) (requires-python:>=3.7.0). Requested demucs from https://files.pythonhosted.org/packages/80/77/4991edb8d4764892260a913048ee607b50da520c4638f2c824ce1bdbe30e/demucs-2.0.0.tar.gz#sha256=a7dac70f14c03163739ba3da59028aae889548c0f6f9f9780b8fa8e43b319b99 has different version in metadata: '2.0.0'
  Using cached demucs-0.0.2.tar.gz (45 kB)
WARNING: Discarding https://files.pythonhosted.org/packages/45/01/b59d89dc34a990ebe5ef66880ca43ec408c31f0a7689975367fd9e52592f/demucs-0.0.2.tar.gz#sha256=4914357489d0d1652f256972c73d385dfee0529c545a8547b139ac88956353e8 (from https://pypi.org/simple/demucs/) (requires-python:>=3.7.0). Requested demucs from https://files.pythonhosted.org/packages/45/01/b59d89dc34a990ebe5ef66880ca43ec408c31f0a7689975367fd9e52592f/demucs-0.0.2.tar.gz#sha256=4914357489d0d1652f256972c73d385dfee0529c545a8547b139ac88956353e8 has different version in metadata: '0.0.2'
  Using cached demucs-0.0.1.tar.gz (45 kB)
    ERROR: Command errored out with exit status 1:
     command: /usr/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-sz3n7y4o/demucs_3db170e5714941f0a591ea7bc3a9dd16/setup.py'"'"'; __file__='"'"'/tmp/pip-install-sz3n7y4o/demucs_3db170e5714941f0a591ea7bc3a9dd16/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-zxt1x3k_
         cwd: /tmp/pip-install-sz3n7y4o/demucs_3db170e5714941f0a591ea7bc3a9dd16/
    Complete output (5 lines):
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-sz3n7y4o/demucs_3db170e5714941f0a591ea7bc3a9dd16/setup.py", line 25, in <module>
        REQUIRED = [i.strip() for i in open(HERE / "requirements.txt")]
    FileNotFoundError: [Errno 2] No such file or directory: '/tmp/pip-install-sz3n7y4o/demucs_3db170e5714941f0a591ea7bc3a9dd16/requirements.txt'
    ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/f0/0b/ebb129e8724e8822e8f94e231118109f73b4a77ff76d47142e0fced854d7/demucs-0.0.1.tar.gz#sha256=76841228f4befedd0e94387c0a0f03e0b3ab8aacf40001a8f4b062b28160535d (from https://pypi.org/simple/demucs/) (requires-python:>=3.7.0). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
  Using cached demucs-0.0.0.tar.gz (1.5 kB)
    ERROR: Command errored out with exit status 1:
     command: /usr/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-sz3n7y4o/demucs_b04439b2272b448d80dba677290fccec/setup.py'"'"'; __file__='"'"'/tmp/pip-install-sz3n7y4o/demucs_b04439b2272b448d80dba677290fccec/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-okmi6md_
         cwd: /tmp/pip-install-sz3n7y4o/demucs_b04439b2272b448d80dba677290fccec/
    Complete output (5 lines):
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-sz3n7y4o/demucs_b04439b2272b448d80dba677290fccec/setup.py", line 19, in <module>
        REQUIRED = [i.strip() for i in open("requirements.txt")]
    FileNotFoundError: [Errno 2] No such file or directory: 'requirements.txt'
    ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/80/04/5d0473a2e1261c3789ff6083febb5f797776a42dbbe069691b9cc73c9f10/demucs-0.0.0.tar.gz#sha256=8050de572ca5806244a28130b71b81d2542a02ebb91f37ff727becd7eb03debf (from https://pypi.org/simple/demucs/) (requires-python:>=3.7.0). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
ERROR: Could not find a version that satisfies the requirement demucs
ERROR: No matching distribution found for demucs

Your Environment

• Python and PyTorch version: Python 3.10.2
• Operating system and version (desktop or mobile): Arch Linux x86_64
• Hardware (gpu or cpu, amount of RAM etc.): AMD Ryzen 7 3700X with 64GB of DDR4.

[adefossez]

The core issue is actually that torch is not available on python 3.10 at the moment, pip install torch fails for me.

Honestly for deep learning tools, you shouldn’t expect being able to use bleeding edge versions of Python. It always takes a bit of time for all the frameworks to adapt, and I know I personally stopped at 3.8 to avoid running into those issues. Things like Google Colab are typically running quite old versions of Python (e.g. 3.8) and sticking to that one means I’m sure I can ship to Colab easily.

[Marviel]

Unfortunately even when running with python 3.9 inside Docker on a Mac M1, this is still happening.

I believe this is also an issue with running Demucs in a Docker container on Mac M1 machines , because lameenc does not have an arm version deployed for linux

I could also have traced my errors wrong. It doesn’t appear that pytorch has an arm64 build available on linux either so…